Max level shown:
1 [ Dec 21 06:11:18 Enabled. ]
2 [ Dec 21 06:11:18 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 21 06:11:18 Method "start" exited with status 0. ]
4 [ Dec 21 06:11:18 Rereading configuration. ]
5 [ Dec 21 06:11:18 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-21T06:11:18.388ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-21T06:11:18.388ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-21T06:11:18.440ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-21T06:11:18.440ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-21T06:11:18.555ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-21T06:11:18.564ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-21T06:11:18.572ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-21T06:11:19.175ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-12-21T06:11:19.315ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-21T06:11:19.315ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-21T06:11:19.315ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-21T06:11:19.315ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-21T06:11:19.315ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-21T06:11:19.315ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-21T06:11:19.318ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-21T06:11:19.318ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-21T06:11:19.318ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-21T06:11:19.318ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-21T06:11:19.318ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-21T06:11:19.318ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-21T06:11:19.318ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-21T06:11:19.318ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-21T06:11:19.318ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-21T06:11:19.329ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-21T06:11:19.329ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool)
322024-12-21T06:11:19.427ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal }
332024-12-21T06:11:19.793ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-21T06:11:19.793ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-21T06:11:19.793ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-21T06:11:19.793ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-21T06:11:19.793ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
382024-12-21T06:11:19.793ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
392024-12-21T06:11:19.793ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
402024-12-21T06:11:19.793ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
412024-12-21T06:11:19.793ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
422024-12-21T06:11:19.793ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
432024-12-21T06:11:19.802ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
442024-12-21T06:11:19.802ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool)
452024-12-21T06:11:19.889ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal }
462024-12-21T06:11:20.258ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
472024-12-21T06:11:20.258ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
482024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
492024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
502024-12-21T06:11:20.258ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
512024-12-21T06:11:20.258ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
522024-12-21T06:11:20.258ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
532024-12-21T06:11:20.258ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
542024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
552024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
562024-12-21T06:11:20.258ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
572024-12-21T06:11:20.258ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
582024-12-21T06:11:20.258ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
592024-12-21T06:11:20.258ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
602024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
612024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
622024-12-21T06:11:20.258ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632024-12-21T06:11:20.258ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
642024-12-21T06:11:20.258ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
652024-12-21T06:11:20.258ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662024-12-21T06:11:20.258ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
672024-12-21T06:11:20.258ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
682024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
692024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
702024-12-21T06:11:20.258ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
712024-12-21T06:11:20.258ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
722024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
732024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
742024-12-21T06:11:20.258ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
752024-12-21T06:11:20.258ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
762024-12-21T06:11:20.258ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
772024-12-21T06:11:20.258ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
782024-12-21T06:11:20.258ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
792024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
802024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
812024-12-21T06:11:20.258ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
822024-12-21T06:11:20.258ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
832024-12-21T06:11:20.258ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
842024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862024-12-21T06:11:20.258ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872024-12-21T06:11:20.258ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
882024-12-21T06:11:20.258ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
892024-12-21T06:11:20.258ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
902024-12-21T06:11:20.258ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-12-21T06:11:20.258ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
922024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-12-21T06:11:20.258ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
952024-12-21T06:11:20.258ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962024-12-21T06:11:20.258ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972024-12-21T06:11:20.258ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
982024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
992024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1002024-12-21T06:11:20.258ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
1012024-12-21T06:11:20.258ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022024-12-21T06:11:20.258ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1032024-12-21T06:11:20.258ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1042024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1052024-12-21T06:11:20.258ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1062024-12-21T06:11:20.258ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1072024-12-21T06:11:20.258ZINFOSledAgent (bootstore): No ledger in /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-12-21T06:11:20.258ZINFOSledAgent (bootstore): No ledger in /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-12-21T06:11:20.258ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1102024-12-21T06:11:20.258ZINFOSledAgent (bootstore): No ledger in /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1112024-12-21T06:11:20.258ZINFOSledAgent (bootstore): No ledger in /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1122024-12-21T06:11:20.258ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1132024-12-21T06:11:20.258ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1142024-12-21T06:11:20.258ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1152024-12-21T06:11:20.269ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1162024-12-21T06:11:20.269ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1411, tv_nsec: 503579221 } time_to_next_cleanup = 599.999924508s
1172024-12-21T06:11:20.269ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1182024-12-21T06:11:20.269ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1192024-12-21T06:11:20.269ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/sled-agent-request.json file = common/src/ledger.rs:188
1202024-12-21T06:11:20.272ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/sled-agent-request.json file = common/src/ledger.rs:188
1212024-12-21T06:11:20.272ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1222024-12-21T06:11:20.274ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1232024-12-21T06:11:20.275ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1242024-12-21T06:11:20.275ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1252024-12-21T06:11:20.275ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1262024-12-21T06:11:20.275ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1272024-12-21T06:11:20.275ZINFOSledAgent (RSS): No ledger in /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/rss-started.marker file = common/src/ledger.rs:188
1282024-12-21T06:11:20.275ZINFOSledAgent (RSS): No ledger in /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/rss-started.marker file = common/src/ledger.rs:188
1292024-12-21T06:11:20.275ZINFOSledAgent (RSS): No ledger in /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1302024-12-21T06:11:20.275ZINFOSledAgent (RSS): No ledger in /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1312024-12-21T06:11:20.275ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1322024-12-21T06:11:20.275ZINFOSledAgent (RSS): Writing ledger to /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1332024-12-21T06:11:20.275ZINFOSledAgent (RSS): Writing ledger to /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1342024-12-21T06:11:20.275ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1352024-12-21T06:11:20.275ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1362024-12-21T06:11:20.275ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1372024-12-21T06:11:20.275ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1382024-12-21T06:11:20.275ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1392024-12-21T06:11:20.275ZINFOSledAgent (bootstore): Writing ledger to /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-12-21T06:11:20.276ZINFOSledAgent (bootstore): Writing ledger to /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1412024-12-21T06:11:20.276ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1422024-12-21T06:11:20.276ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: cf7f8320-e45e-46f1-aa3b-b101ce937c63 (sled), rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1432024-12-21T06:11:20.276ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1442024-12-21T06:11:20.276ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1452024-12-21T06:11:20.281ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1462024-12-21T06:11:20.287ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1472024-12-21T06:11:20.287ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1482024-12-21T06:11:20.291ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1492024-12-21T06:11:20.291ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1502024-12-21T06:11:20.291ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63719
1512024-12-21T06:11:20.291ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: cf7f8320-e45e-46f1-aa3b-b101ce937c63 (sled), rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1522024-12-21T06:11:20.291ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1532024-12-21T06:11:20.291ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1542024-12-21T06:11:20.291ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1552024-12-21T06:11:20.291ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1562024-12-21T06:11:20.291ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1572024-12-21T06:11:20.291ZINFOSledAgent (StorageManager): No ledger in /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-12-21T06:11:20.291ZINFOSledAgent (StorageManager): No ledger in /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-12-21T06:11:20.291ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1602024-12-21T06:11:20.291ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1612024-12-21T06:11:20.291ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1622024-12-21T06:11:20.291ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1632024-12-21T06:11:20.291ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1642024-12-21T06:11:20.291ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1652024-12-21T06:11:20.307ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1662024-12-21T06:11:20.327ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1672024-12-21T06:11:20.344ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1682024-12-21T06:11:20.368ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
1692024-12-21T06:11:20.368ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1702024-12-21T06:11:20.368ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
1712024-12-21T06:11:20.368ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1722024-12-21T06:11:20.371ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 120.732904ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f0820535-bccb-4342-bbf9-bf5228872cc8", "content-length": "124", "date": "Sat, 21 Dec 2024 06:11:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f0820535-bccb-4342-bbf9-bf5228872cc8" } file = clients/ddm-admin-client/src/lib.rs:177
1732024-12-21T06:11:20.381ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_2fc111fe-2b5c-4525-a70e-914c88174261/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1742024-12-21T06:11:20.404ZINFOSledAgent: successfully created encrypted zvol: name="oxi_2fc111fe-2b5c-4525-a70e-914c88174261/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1752024-12-21T06:11:20.405ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_2fc111fe-2b5c-4525-a70e-914c88174261/swap" file = sled-agent/src/swap_device.rs:96
1762024-12-21T06:11:20.415ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
1772024-12-21T06:11:20.415ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1782024-12-21T06:11:20.415ZINFOSledAgent (BackingFs): Ensuring dataset oxi_2fc111fe-2b5c-4525-a70e-914c88174261/backing/fmd file = sled-agent/src/backing_fs.rs:139
1792024-12-21T06:11:20.480ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1802024-12-21T06:11:20.493ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1812024-12-21T06:11:20.494ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 164.675031ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ced6f7d5-96b5-46a6-89c7-8d668a2a691b", "content-length": "124", "date": "Sat, 21 Dec 2024 06:11:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ced6f7d5-96b5-46a6-89c7-8d668a2a691b" } file = clients/ddm-admin-client/src/lib.rs:177
1822024-12-21T06:11:20.660ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-12-21T06:11:20.660ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 85.159531ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6d67fc57-b4a0-45a2-9129-bbde4258fe75", "content-length": "124", "date": "Sat, 21 Dec 2024 06:11:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6d67fc57-b4a0-45a2-9129-bbde4258fe75" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-12-21T06:11:20.699ZINFOSledAgent (BackingFs): Mounting oxi_2fc111fe-2b5c-4525-a70e-914c88174261/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1852024-12-21T06:11:20.711ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1862024-12-21T06:11:20.711ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1872024-12-21T06:11:20.711ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1882024-12-21T06:11:20.711ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1892024-12-21T06:11:20.746ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1902024-12-21T06:11:20.747ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 248.531122ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cc39f2d0-6de9-4ea8-b4d3-e5bc41444ed8", "content-length": "124", "date": "Sat, 21 Dec 2024 06:11:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cc39f2d0-6de9-4ea8-b4d3-e5bc41444ed8" } file = clients/ddm-admin-client/src/lib.rs:177
1912024-12-21T06:11:20.997ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1922024-12-21T06:11:20.998ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 118.114486ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7bb47bbd-50e4-4f8e-92d7-ad7af28fa8ce", "content-length": "124", "date": "Sat, 21 Dec 2024 06:11:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7bb47bbd-50e4-4f8e-92d7-ad7af28fa8ce" } file = clients/ddm-admin-client/src/lib.rs:177
1932024-12-21T06:11:21.117ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1942024-12-21T06:11:21.117ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 277.955298ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c85c040c-fe1b-4c65-b476-3bf4954b9f6f", "content-length": "124", "date": "Sat, 21 Dec 2024 06:11:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c85c040c-fe1b-4c65-b476-3bf4954b9f6f" } file = clients/ddm-admin-client/src/lib.rs:177
1952024-12-21T06:11:21.397ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1962024-12-21T06:11:21.397ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 417.650209ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "63afa64d-d34d-4593-9d05-85bdc696545c", "content-length": "124", "date": "Sat, 21 Dec 2024 06:11:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "63afa64d-d34d-4593-9d05-85bdc696545c" } file = clients/ddm-admin-client/src/lib.rs:177
1972024-12-21T06:11:21.449ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
1982024-12-21T06:11:21.454ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:35662 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
1992024-12-21T06:11:21.454ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2002024-12-21T06:11:21.454ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:35662 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2012024-12-21T06:11:21.456ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 344.221799ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2022024-12-21T06:11:21.457ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2032024-12-21T06:11:21.457ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2042024-12-21T06:11:21.457ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2052024-12-21T06:11:21.457ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2062024-12-21T06:11:21.801ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 257.314356ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2072024-12-21T06:11:21.815ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2082024-12-21T06:11:22.060ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.056094275s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2092024-12-21T06:11:23.118ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.317066559s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2102024-12-21T06:11:24.131ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2112024-12-21T06:11:24.131ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2122024-12-21T06:11:24.131ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2132024-12-21T06:11:24.131ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2142024-12-21T06:11:24.131ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2152024-12-21T06:11:24.131ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2162024-12-21T06:11:24.133ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2172024-12-21T06:11:24.134ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2182024-12-21T06:11:24.134ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='47090b0b-c8ad-4dca-92e5-38fed29ad6d5'/> <propval type="astring" name="rack_id" value='b4677cb0-5cb7-4375-8dec-b17ff2acf8f5'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe7d:a6d'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='b4677cb0-5cb7-4375-8dec-b17ff2acf8f5'/> <propval type="astring" name="sled_id" value='cf7f8320-e45e-46f1-aa3b-b101ce937c63'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='cf7f8320-e45e-46f1-aa3b-b101ce937c63'/> <propval type="astring" name="rack_uuid" value='b4677cb0-5cb7-4375-8dec-b17ff2acf8f5'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='cf7f8320-e45e-46f1-aa3b-b101ce937c63'/> <propval type="astring" name="rack_uuid" value='b4677cb0-5cb7-4375-8dec-b17ff2acf8f5'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2192024-12-21T06:11:24.134ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2202024-12-21T06:11:24.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 25.769604ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-21T06:11:24.437ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.875825239s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2222024-12-21T06:11:24.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 53.678102ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-21T06:11:24.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 244.837283ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-21T06:11:25.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 333.878814ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-21T06:11:25.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 576.427541ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-12-21T06:11:26.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.329399264s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-12-21T06:11:27.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.341603423s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-12-21T06:11:29.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 865.744081ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-12-21T06:11:30.275ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/cf7f8320-e45e-46f1-aa3b-b101ce937c63) file = sled-agent/src/nexus.rs:527 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2302024-12-21T06:11:30.306ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2312024-12-21T06:11:30.306ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2322024-12-21T06:11:30.307ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2332024-12-21T06:11:30.307ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2342024-12-21T06:11:30.307ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2352024-12-21T06:11:30.307ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-12-21T06:11:30.307ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-12-21T06:11:30.308ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2382024-12-21T06:11:30.308ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2392024-12-21T06:11:30.308ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2402024-12-21T06:11:30.308ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63719
2412024-12-21T06:11:30.511ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2422024-12-21T06:11:30.511ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2432024-12-21T06:11:30.512ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 6.509768075s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2442024-12-21T06:11:30.517ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2452024-12-21T06:11:30.517ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2462024-12-21T06:11:30.517ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2472024-12-21T06:11:30.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40532
2482024-12-21T06:11:30.765ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2492024-12-21T06:11:30.765ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2502024-12-21T06:11:30.765ZINFOSledAgent (ServiceManager): No ledger in /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-zones.json file = common/src/ledger.rs:188
2512024-12-21T06:11:30.765ZINFOSledAgent (ServiceManager): No ledger in /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-zones.json file = common/src/ledger.rs:188
2522024-12-21T06:11:30.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 471 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40532 req_id = 8f338868-17b9-4f54-bee5-a4e392a47515 response_code = 200 uri = /inventory
2532024-12-21T06:11:30.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63181
2542024-12-21T06:11:30.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63181 req_id = 4f590e21-4185-4f1f-a021-b936c6486043 response_code = 200 uri = /sled-role
2552024-12-21T06:11:30.828ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 807aad46-d49f-4233-a84e-2c36efeada09 (physical_disk), pool_id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: a9e70ee2-faf2-4e7d-b2b2-0db70e6f3252 (physical_disk), pool_id: c50bda89-deae-4199-9adf-06dda470c3af (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 36d38131-33c0-4a08-83a7-56982ff45adf (physical_disk), pool_id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 0a0ae0e7-e622-44c8-9196-7ea1940fab92 (physical_disk), pool_id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: bb87f815-ed6b-4ea9-99ea-c85fed0ed3ff (physical_disk), pool_id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 1782aea5-1b39-4344-9c07-afda9f07bce3 (physical_disk), pool_id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 608a7097-600d-48c2-91a7-cc866f2ab1ab (physical_disk), pool_id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7612bb9d-153e-43fe-9612-5470980bf421 (physical_disk), pool_id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ce80ddec-bc97-4241-9d9e-23176c152d8d (physical_disk), pool_id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2562024-12-21T06:11:30.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42523
2572024-12-21T06:11:30.828ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2582024-12-21T06:11:30.828ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 807aad46-d49f-4233-a84e-2c36efeada09 (physical_disk), pool_id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: a9e70ee2-faf2-4e7d-b2b2-0db70e6f3252 (physical_disk), pool_id: c50bda89-deae-4199-9adf-06dda470c3af (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 36d38131-33c0-4a08-83a7-56982ff45adf (physical_disk), pool_id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 0a0ae0e7-e622-44c8-9196-7ea1940fab92 (physical_disk), pool_id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: bb87f815-ed6b-4ea9-99ea-c85fed0ed3ff (physical_disk), pool_id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 1782aea5-1b39-4344-9c07-afda9f07bce3 (physical_disk), pool_id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 608a7097-600d-48c2-91a7-cc866f2ab1ab (physical_disk), pool_id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7612bb9d-153e-43fe-9612-5470980bf421 (physical_disk), pool_id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ce80ddec-bc97-4241-9d9e-23176c152d8d (physical_disk), pool_id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2592024-12-21T06:11:30.828ZINFOSledAgent (StorageManager): No ledger in /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602024-12-21T06:11:30.828ZINFOSledAgent (StorageManager): No ledger in /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2612024-12-21T06:11:30.828ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2622024-12-21T06:11:30.828ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2632024-12-21T06:11:30.828ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2642024-12-21T06:11:30.828ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2652024-12-21T06:11:30.828ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2662024-12-21T06:11:31.014ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2672024-12-21T06:11:31.014ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool)
2682024-12-21T06:11:31.476ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13226585348842622236 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2692024-12-21T06:11:31.476ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14437650190339355793 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2702024-12-21T06:11:31.476ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63) file = sled-agent/src/probe_manager.rs:231 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2712024-12-21T06:11:31.931ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
2722024-12-21T06:11:31.961ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }
2732024-12-21T06:11:31.969ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2742024-12-21T06:11:31.969ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2752024-12-21T06:11:31.969ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2762024-12-21T06:11:31.969ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2772024-12-21T06:11:31.969ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2782024-12-21T06:11:31.969ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2792024-12-21T06:11:31.969ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2802024-12-21T06:11:32.003ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2812024-12-21T06:11:32.010ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone file = sled-storage/src/dataset.rs:302
2822024-12-21T06:11:32.145ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 file = sled-storage/src/dataset.rs:388
2832024-12-21T06:11:32.153ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2842024-12-21T06:11:32.153ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2852024-12-21T06:11:32.153ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2862024-12-21T06:11:32.153ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2872024-12-21T06:11:32.153ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2882024-12-21T06:11:32.162ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2892024-12-21T06:11:32.162ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c50bda89-deae-4199-9adf-06dda470c3af (zpool)
2902024-12-21T06:11:32.250ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }
2912024-12-21T06:11:32.257ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2922024-12-21T06:11:32.257ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2932024-12-21T06:11:32.257ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2942024-12-21T06:11:32.257ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2952024-12-21T06:11:32.257ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2962024-12-21T06:11:32.257ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2972024-12-21T06:11:32.257ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2982024-12-21T06:11:32.290ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2992024-12-21T06:11:32.297ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone file = sled-storage/src/dataset.rs:302
3002024-12-21T06:11:32.426ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c50bda89-deae-4199-9adf-06dda470c3af file = sled-storage/src/dataset.rs:388
3012024-12-21T06:11:32.433ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3022024-12-21T06:11:32.433ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3032024-12-21T06:11:32.433ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3042024-12-21T06:11:32.433ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3052024-12-21T06:11:32.433ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3062024-12-21T06:11:32.442ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3072024-12-21T06:11:32.442ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool)
3082024-12-21T06:11:32.530ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }
3092024-12-21T06:11:32.538ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3102024-12-21T06:11:32.538ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3112024-12-21T06:11:32.538ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3122024-12-21T06:11:32.538ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3132024-12-21T06:11:32.538ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3142024-12-21T06:11:32.538ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3152024-12-21T06:11:32.538ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3162024-12-21T06:11:32.541ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63) file = sled-agent/src/probe_manager.rs:231 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
3172024-12-21T06:11:32.572ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3182024-12-21T06:11:32.580ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone file = sled-storage/src/dataset.rs:302
3192024-12-21T06:11:32.713ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_13ee308e-c433-469e-b9ea-1dbf54a60851 file = sled-storage/src/dataset.rs:388
3202024-12-21T06:11:32.721ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3212024-12-21T06:11:32.721ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3222024-12-21T06:11:32.721ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3232024-12-21T06:11:32.721ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3242024-12-21T06:11:32.721ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3252024-12-21T06:11:32.732ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3262024-12-21T06:11:32.732ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool)
3272024-12-21T06:11:32.822ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }
3282024-12-21T06:11:32.830ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3292024-12-21T06:11:32.830ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3302024-12-21T06:11:32.830ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3312024-12-21T06:11:32.830ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3322024-12-21T06:11:32.830ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3332024-12-21T06:11:32.830ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3342024-12-21T06:11:32.830ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3352024-12-21T06:11:32.863ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3362024-12-21T06:11:32.870ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/zone file = sled-storage/src/dataset.rs:302
3372024-12-21T06:11:33.008ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb file = sled-storage/src/dataset.rs:388
3382024-12-21T06:11:33.017ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3392024-12-21T06:11:33.017ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3402024-12-21T06:11:33.017ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3412024-12-21T06:11:33.017ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3422024-12-21T06:11:33.017ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3432024-12-21T06:11:33.026ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3442024-12-21T06:11:33.026ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool)
3452024-12-21T06:11:33.120ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }
3462024-12-21T06:11:33.129ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3472024-12-21T06:11:33.129ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3482024-12-21T06:11:33.129ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3492024-12-21T06:11:33.130ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3502024-12-21T06:11:33.130ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3512024-12-21T06:11:33.130ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3522024-12-21T06:11:33.130ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3532024-12-21T06:11:33.165ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3542024-12-21T06:11:33.173ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crypt/zone file = sled-storage/src/dataset.rs:302
3552024-12-21T06:11:33.310ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c file = sled-storage/src/dataset.rs:388
3562024-12-21T06:11:33.317ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3572024-12-21T06:11:33.317ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3582024-12-21T06:11:33.317ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3592024-12-21T06:11:33.317ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3602024-12-21T06:11:33.317ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3612024-12-21T06:11:33.327ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3622024-12-21T06:11:33.327ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool)
3632024-12-21T06:11:33.417ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }
3642024-12-21T06:11:33.424ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3652024-12-21T06:11:33.424ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3662024-12-21T06:11:33.424ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3672024-12-21T06:11:33.424ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3682024-12-21T06:11:33.424ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3692024-12-21T06:11:33.424ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3702024-12-21T06:11:33.424ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3712024-12-21T06:11:33.458ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3722024-12-21T06:11:33.466ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0/crypt/zone file = sled-storage/src/dataset.rs:302
3732024-12-21T06:11:33.544ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63) file = sled-agent/src/probe_manager.rs:231 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
3742024-12-21T06:11:33.602ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0 file = sled-storage/src/dataset.rs:388
3752024-12-21T06:11:33.610ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3762024-12-21T06:11:33.610ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3772024-12-21T06:11:33.610ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3782024-12-21T06:11:33.610ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3792024-12-21T06:11:33.610ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3802024-12-21T06:11:33.620ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3812024-12-21T06:11:33.620ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool)
3822024-12-21T06:11:33.718ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }
3832024-12-21T06:11:33.726ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3842024-12-21T06:11:33.726ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3852024-12-21T06:11:33.726ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3862024-12-21T06:11:33.726ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3872024-12-21T06:11:33.726ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3882024-12-21T06:11:33.726ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3892024-12-21T06:11:33.726ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3902024-12-21T06:11:33.763ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3912024-12-21T06:11:33.770ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24/crypt/zone file = sled-storage/src/dataset.rs:302
3922024-12-21T06:11:33.909ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24 file = sled-storage/src/dataset.rs:388
3932024-12-21T06:11:33.918ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3942024-12-21T06:11:33.918ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3952024-12-21T06:11:33.918ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3962024-12-21T06:11:33.918ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3972024-12-21T06:11:33.918ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3982024-12-21T06:11:33.931ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3992024-12-21T06:11:33.931ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool)
4002024-12-21T06:11:34.027ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }
4012024-12-21T06:11:34.035ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4022024-12-21T06:11:34.035ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4032024-12-21T06:11:34.035ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4042024-12-21T06:11:34.035ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4052024-12-21T06:11:34.035ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4062024-12-21T06:11:34.035ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4072024-12-21T06:11:34.035ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4082024-12-21T06:11:34.070ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4092024-12-21T06:11:34.078ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/zone file = sled-storage/src/dataset.rs:302
4102024-12-21T06:11:34.216ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a file = sled-storage/src/dataset.rs:388
4112024-12-21T06:11:34.224ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4122024-12-21T06:11:34.224ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4132024-12-21T06:11:34.224ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4142024-12-21T06:11:34.224ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4152024-12-21T06:11:34.224ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4162024-12-21T06:11:34.234ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4172024-12-21T06:11:34.234ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 957b9893-852a-42fc-af5f-4cd146632a7e (zpool)
4182024-12-21T06:11:34.332ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }
4192024-12-21T06:11:34.341ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4202024-12-21T06:11:34.341ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4212024-12-21T06:11:34.341ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4222024-12-21T06:11:34.341ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4232024-12-21T06:11:34.341ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4242024-12-21T06:11:34.341ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4252024-12-21T06:11:34.341ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4262024-12-21T06:11:34.387ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4272024-12-21T06:11:34.395ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_957b9893-852a-42fc-af5f-4cd146632a7e/crypt/zone file = sled-storage/src/dataset.rs:302
4282024-12-21T06:11:34.538ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_957b9893-852a-42fc-af5f-4cd146632a7e file = sled-storage/src/dataset.rs:388
4292024-12-21T06:11:34.546ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63) file = sled-agent/src/probe_manager.rs:231 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
4302024-12-21T06:11:34.546ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4312024-12-21T06:11:34.546ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4322024-12-21T06:11:34.546ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332024-12-21T06:11:34.546ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2fc111fe-2b5c-4525-a70e-914c88174261 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01f1b5f4-2545-4293-a417-f1e0bbf620d0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4342024-12-21T06:11:34.546ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4352024-12-21T06:11:34.546ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4362024-12-21T06:11:34.546ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4372024-12-21T06:11:34.546ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
4382024-12-21T06:11:34.546ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4392024-12-21T06:11:34.546ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
4402024-12-21T06:11:34.546ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
4412024-12-21T06:11:34.546ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
4422024-12-21T06:11:34.546ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
4432024-12-21T06:11:34.546ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
4442024-12-21T06:11:34.546ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4452024-12-21T06:11:34.546ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
4462024-12-21T06:11:34.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3718312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42523 req_id = e597229b-d9c3-46f6-b1af-c9f2249aab18 response_code = 200 uri = /omicron-physical-disks
4472024-12-21T06:11:34.578ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {07b9583c-b303-444e-8070-ca7f796b9f28 (dataset): DatasetConfig { id: 07b9583c-b303-444e-8070-ca7f796b9f28 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b03a383-8a32-4f9f-aa64-c2f61f6581c4 (dataset): DatasetConfig { id: 0b03a383-8a32-4f9f-aa64-c2f61f6581c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0eafeaa9-e393-4a4c-abb1-0974e83df049 (dataset): DatasetConfig { id: 0eafeaa9-e393-4a4c-abb1-0974e83df049 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 112c0eb3-5989-48c9-949d-3cab61fca069 (dataset): DatasetConfig { id: 112c0eb3-5989-48c9-949d-3cab61fca069 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1447e024-0108-487c-bbbf-3524d36c6299 (dataset): DatasetConfig { id: 1447e024-0108-487c-bbbf-3524d36c6299 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1fdd96d7-8f3d-4d23-ae0b-d3467ae5109c (dataset): DatasetConfig { id: 1fdd96d7-8f3d-4d23-ae0b-d3467ae5109c (dataset), name: DatasetName { pool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2270199c-a9d3-4d5f-b648-320cd3446b8c (dataset): DatasetConfig { id: 2270199c-a9d3-4d5f-b648-320cd3446b8c (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 254842b9-4055-40c2-bfda-44555aab5d2b (dataset): DatasetConfig { id: 254842b9-4055-40c2-bfda-44555aab5d2b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 266bc9a9-d5bd-466c-bd77-86a410d2e163 (dataset): DatasetConfig { id: 266bc9a9-d5bd-466c-bd77-86a410d2e163 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2926b9b1-5609-4271-893e-57b6d2bf8630 (dataset): DatasetConfig { id: 2926b9b1-5609-4271-893e-57b6d2bf8630 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 297d4edd-47bf-40e3-a3b1-dd6b2d5df686 (dataset): DatasetConfig { id: 297d4edd-47bf-40e3-a3b1-dd6b2d5df686 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a803b0a-466f-4e07-82b5-56dbb468affd (dataset): DatasetConfig { id: 2a803b0a-466f-4e07-82b5-56dbb468affd (dataset), name: DatasetName { pool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33c7d5a7-eb29-41b0-8226-ac33e6fa618c (dataset): DatasetConfig { id: 33c7d5a7-eb29-41b0-8226-ac33e6fa618c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f39499d-933e-4de3-b1c1-7dd080e22d6b (dataset): DatasetConfig { id: 3f39499d-933e-4de3-b1c1-7dd080e22d6b (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 471f3f73-1bd5-4933-90b0-072aafb3062d (dataset): DatasetConfig { id: 471f3f73-1bd5-4933-90b0-072aafb3062d (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e6f6b7a-ff90-4aaa-8694-1b94312ffa92 (dataset): DatasetConfig { id: 4e6f6b7a-ff90-4aaa-8694-1b94312ffa92 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e79ed6b-88c1-4752-9ad6-12df5ba32aa5 (dataset): DatasetConfig { id: 4e79ed6b-88c1-4752-9ad6-12df5ba32aa5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 504dc7e2-8e05-4ae2-9029-9a26bcaa98db (dataset): DatasetConfig { id: 504dc7e2-8e05-4ae2-9029-9a26bcaa98db (dataset), name: DatasetName { pool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51a7d4db-8f4d-4aef-a50c-ccd15646ba6e (dataset): DatasetConfig { id: 51a7d4db-8f4d-4aef-a50c-ccd15646ba6e (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58272d9d-197a-4d72-9d59-acc50cf41908 (dataset): DatasetConfig { id: 58272d9d-197a-4d72-9d59-acc50cf41908 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5abf39bd-1659-41e5-83e1-ad495c055e8b (dataset): DatasetConfig { id: 5abf39bd-1659-41e5-83e1-ad495c055e8b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5e66336c-794b-443e-843a-345df4e7b64d (dataset): DatasetConfig { id: 5e66336c-794b-443e-843a-345df4e7b64d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 654d7a89-c8ca-4d4b-8c3e-5362ad5aed03 (dataset): DatasetConfig { id: 654d7a89-c8ca-4d4b-8c3e-5362ad5aed03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65f02669-144b-4568-ad89-37c3291784a1 (dataset): DatasetConfig { id: 65f02669-144b-4568-ad89-37c3291784a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6772e929-52c5-4b34-a5e0-a280ad433859 (dataset): DatasetConfig { id: 6772e929-52c5-4b34-a5e0-a280ad433859 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 67a8cdb0-2704-4a1a-9412-51e63a673f68 (dataset): DatasetConfig { id: 67a8cdb0-2704-4a1a-9412-51e63a673f68 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68738b34-3db6-43d8-bcb4-e71e0f9ff1fc (dataset): DatasetConfig { id: 68738b34-3db6-43d8-bcb4-e71e0f9ff1fc (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 695bc99f-f2de-4391-8307-9caa8a34ad62 (dataset): DatasetConfig { id: 695bc99f-f2de-4391-8307-9caa8a34ad62 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f4ceebe-c935-46c5-8ade-21bc50fe7680 (dataset): DatasetConfig { id: 6f4ceebe-c935-46c5-8ade-21bc50fe7680 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7021ffb3-464a-4021-bdd5-55be694281fa (dataset): DatasetConfig { id: 7021ffb3-464a-4021-bdd5-55be694281fa (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71d6c804-beb7-429d-a13d-01ada0b31281 (dataset): DatasetConfig { id: 71d6c804-beb7-429d-a13d-01ada0b31281 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71e5ffeb-9ce1-4b30-8517-1ab9b69d0a89 (dataset): DatasetConfig { id: 71e5ffeb-9ce1-4b30-8517-1ab9b69d0a89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 747dc6b2-ff39-4589-a1ae-196a7540e340 (dataset): DatasetConfig { id: 747dc6b2-ff39-4589-a1ae-196a7540e340 (dataset), name: DatasetName { pool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78355567-d757-4c6a-9bc3-6bda1276f9ae (dataset): DatasetConfig { id: 78355567-d757-4c6a-9bc3-6bda1276f9ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a303b8b-8513-4abf-9c39-48df1e1f77da (dataset): DatasetConfig { id: 7a303b8b-8513-4abf-9c39-48df1e1f77da (dataset), name: DatasetName { pool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7afbc0d5-6bc6-4753-9afd-38fb66ad3ac7 (dataset): DatasetConfig { id: 7afbc0d5-6bc6-4753-9afd-38fb66ad3ac7 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b0bfea2-9783-4bb7-b003-ad780859794d (dataset): DatasetConfig { id: 7b0bfea2-9783-4bb7-b003-ad780859794d (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b5fd4c0-f70a-4add-8501-072448518307 (dataset): DatasetConfig { id: 7b5fd4c0-f70a-4add-8501-072448518307 (dataset), name: DatasetName { pool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90efea0b-af94-41b7-be77-054b8760294c (dataset): DatasetConfig { id: 90efea0b-af94-41b7-be77-054b8760294c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92c14844-2fd4-4743-9470-780c9655a730 (dataset): DatasetConfig { id: 92c14844-2fd4-4743-9470-780c9655a730 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 976458f8-03d2-491c-8559-11062dfd458b (dataset): DatasetConfig { id: 976458f8-03d2-491c-8559-11062dfd458b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a758a6c-d9d2-4c61-858d-902cdf4a6948 (dataset): DatasetConfig { id: 9a758a6c-d9d2-4c61-858d-902cdf4a6948 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c1fe4b4-6556-415e-b617-ca84cd50e906 (dataset): DatasetConfig { id: 9c1fe4b4-6556-415e-b617-ca84cd50e906 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac179c83-b1a9-41e8-aaec-20e9aacaefb4 (dataset): DatasetConfig { id: ac179c83-b1a9-41e8-aaec-20e9aacaefb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b34f7937-5b58-48a4-8ed4-c4e7e4fdb81a (dataset): DatasetConfig { id: b34f7937-5b58-48a4-8ed4-c4e7e4fdb81a (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcf50f02-748d-4bc6-8852-aa5b58b032a2 (dataset): DatasetConfig { id: bcf50f02-748d-4bc6-8852-aa5b58b032a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c063772a-2337-4a0c-9361-9f2d996ec3e1 (dataset): DatasetConfig { id: c063772a-2337-4a0c-9361-9f2d996ec3e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4292e8d-43b2-451b-b2a4-cf764256e552 (dataset): DatasetConfig { id: c4292e8d-43b2-451b-b2a4-cf764256e552 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca6dbb07-e576-479c-918e-50dc3f21d92f (dataset): DatasetConfig { id: ca6dbb07-e576-479c-918e-50dc3f21d92f (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd4d8c87-6017-4d77-983e-bdc0e4b09e35 (dataset): DatasetConfig { id: cd4d8c87-6017-4d77-983e-bdc0e4b09e35 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cde7a5d6-682e-49a3-a6bf-ab8e3b18497b (dataset): DatasetConfig { id: cde7a5d6-682e-49a3-a6bf-ab8e3b18497b (dataset), name: DatasetName { pool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce4f6e0f-9c7c-46c2-a508-89b69524f846 (dataset): DatasetConfig { id: ce4f6e0f-9c7c-46c2-a508-89b69524f846 (dataset), name: DatasetName { pool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d14a8839-1504-4898-a5a0-a30071305a92 (dataset): DatasetConfig { id: d14a8839-1504-4898-a5a0-a30071305a92 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3b49c36-04b0-41bd-8859-975276e19017 (dataset): DatasetConfig { id: d3b49c36-04b0-41bd-8859-975276e19017 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5dbffaa-6b14-4665-acf3-735e32df2696 (dataset): DatasetConfig { id: d5dbffaa-6b14-4665-acf3-735e32df2696 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d667c4cd-e8eb-4ad1-a851-25dd58a21525 (dataset): DatasetConfig { id: d667c4cd-e8eb-4ad1-a851-25dd58a21525 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7149037-5978-4030-819a-0bc684508daf (dataset): DatasetConfig { id: d7149037-5978-4030-819a-0bc684508daf (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8cd7586-12d7-40db-af4b-10c3085a3bed (dataset): DatasetConfig { id: d8cd7586-12d7-40db-af4b-10c3085a3bed (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7add4bc-f983-4288-a5d2-e889f594d408 (dataset): DatasetConfig { id: e7add4bc-f983-4288-a5d2-e889f594d408 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e96d825c-a2be-41a7-9143-c9a002790cea (dataset): DatasetConfig { id: e96d825c-a2be-41a7-9143-c9a002790cea (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eefb2074-1344-439e-8115-329b8b7bca1b (dataset): DatasetConfig { id: eefb2074-1344-439e-8115-329b8b7bca1b (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef75004e-a0bc-451b-8905-5e926f96bf30 (dataset): DatasetConfig { id: ef75004e-a0bc-451b-8905-5e926f96bf30 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2781556-f828-4874-aafa-f4ee0a682ee1 (dataset): DatasetConfig { id: f2781556-f828-4874-aafa-f4ee0a682ee1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f2acc426-8187-47fd-ac1a-470261f599ea (dataset): DatasetConfig { id: f2acc426-8187-47fd-ac1a-470261f599ea (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5c305ce-8447-4a3a-a892-73f7bf87bd7c (dataset): DatasetConfig { id: f5c305ce-8447-4a3a-a892-73f7bf87bd7c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8643f75-52e5-435a-9047-f51d30ff1ed4 (dataset): DatasetConfig { id: f8643f75-52e5-435a-9047-f51d30ff1ed4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4482024-12-21T06:11:34.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54879
4492024-12-21T06:11:34.579ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
4502024-12-21T06:11:34.579ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {07b9583c-b303-444e-8070-ca7f796b9f28 (dataset): DatasetConfig { id: 07b9583c-b303-444e-8070-ca7f796b9f28 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b03a383-8a32-4f9f-aa64-c2f61f6581c4 (dataset): DatasetConfig { id: 0b03a383-8a32-4f9f-aa64-c2f61f6581c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0eafeaa9-e393-4a4c-abb1-0974e83df049 (dataset): DatasetConfig { id: 0eafeaa9-e393-4a4c-abb1-0974e83df049 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 112c0eb3-5989-48c9-949d-3cab61fca069 (dataset): DatasetConfig { id: 112c0eb3-5989-48c9-949d-3cab61fca069 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1447e024-0108-487c-bbbf-3524d36c6299 (dataset): DatasetConfig { id: 1447e024-0108-487c-bbbf-3524d36c6299 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1fdd96d7-8f3d-4d23-ae0b-d3467ae5109c (dataset): DatasetConfig { id: 1fdd96d7-8f3d-4d23-ae0b-d3467ae5109c (dataset), name: DatasetName { pool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2270199c-a9d3-4d5f-b648-320cd3446b8c (dataset): DatasetConfig { id: 2270199c-a9d3-4d5f-b648-320cd3446b8c (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 254842b9-4055-40c2-bfda-44555aab5d2b (dataset): DatasetConfig { id: 254842b9-4055-40c2-bfda-44555aab5d2b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 266bc9a9-d5bd-466c-bd77-86a410d2e163 (dataset): DatasetConfig { id: 266bc9a9-d5bd-466c-bd77-86a410d2e163 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2926b9b1-5609-4271-893e-57b6d2bf8630 (dataset): DatasetConfig { id: 2926b9b1-5609-4271-893e-57b6d2bf8630 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 297d4edd-47bf-40e3-a3b1-dd6b2d5df686 (dataset): DatasetConfig { id: 297d4edd-47bf-40e3-a3b1-dd6b2d5df686 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a803b0a-466f-4e07-82b5-56dbb468affd (dataset): DatasetConfig { id: 2a803b0a-466f-4e07-82b5-56dbb468affd (dataset), name: DatasetName { pool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33c7d5a7-eb29-41b0-8226-ac33e6fa618c (dataset): DatasetConfig { id: 33c7d5a7-eb29-41b0-8226-ac33e6fa618c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f39499d-933e-4de3-b1c1-7dd080e22d6b (dataset): DatasetConfig { id: 3f39499d-933e-4de3-b1c1-7dd080e22d6b (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 471f3f73-1bd5-4933-90b0-072aafb3062d (dataset): DatasetConfig { id: 471f3f73-1bd5-4933-90b0-072aafb3062d (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e6f6b7a-ff90-4aaa-8694-1b94312ffa92 (dataset): DatasetConfig { id: 4e6f6b7a-ff90-4aaa-8694-1b94312ffa92 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e79ed6b-88c1-4752-9ad6-12df5ba32aa5 (dataset): DatasetConfig { id: 4e79ed6b-88c1-4752-9ad6-12df5ba32aa5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 504dc7e2-8e05-4ae2-9029-9a26bcaa98db (dataset): DatasetConfig { id: 504dc7e2-8e05-4ae2-9029-9a26bcaa98db (dataset), name: DatasetName { pool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51a7d4db-8f4d-4aef-a50c-ccd15646ba6e (dataset): DatasetConfig { id: 51a7d4db-8f4d-4aef-a50c-ccd15646ba6e (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58272d9d-197a-4d72-9d59-acc50cf41908 (dataset): DatasetConfig { id: 58272d9d-197a-4d72-9d59-acc50cf41908 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5abf39bd-1659-41e5-83e1-ad495c055e8b (dataset): DatasetConfig { id: 5abf39bd-1659-41e5-83e1-ad495c055e8b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5e66336c-794b-443e-843a-345df4e7b64d (dataset): DatasetConfig { id: 5e66336c-794b-443e-843a-345df4e7b64d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 654d7a89-c8ca-4d4b-8c3e-5362ad5aed03 (dataset): DatasetConfig { id: 654d7a89-c8ca-4d4b-8c3e-5362ad5aed03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65f02669-144b-4568-ad89-37c3291784a1 (dataset): DatasetConfig { id: 65f02669-144b-4568-ad89-37c3291784a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6772e929-52c5-4b34-a5e0-a280ad433859 (dataset): DatasetConfig { id: 6772e929-52c5-4b34-a5e0-a280ad433859 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 67a8cdb0-2704-4a1a-9412-51e63a673f68 (dataset): DatasetConfig { id: 67a8cdb0-2704-4a1a-9412-51e63a673f68 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68738b34-3db6-43d8-bcb4-e71e0f9ff1fc (dataset): DatasetConfig { id: 68738b34-3db6-43d8-bcb4-e71e0f9ff1fc (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 695bc99f-f2de-4391-8307-9caa8a34ad62 (dataset): DatasetConfig { id: 695bc99f-f2de-4391-8307-9caa8a34ad62 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f4ceebe-c935-46c5-8ade-21bc50fe7680 (dataset): DatasetConfig { id: 6f4ceebe-c935-46c5-8ade-21bc50fe7680 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7021ffb3-464a-4021-bdd5-55be694281fa (dataset): DatasetConfig { id: 7021ffb3-464a-4021-bdd5-55be694281fa (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71d6c804-beb7-429d-a13d-01ada0b31281 (dataset): DatasetConfig { id: 71d6c804-beb7-429d-a13d-01ada0b31281 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71e5ffeb-9ce1-4b30-8517-1ab9b69d0a89 (dataset): DatasetConfig { id: 71e5ffeb-9ce1-4b30-8517-1ab9b69d0a89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 747dc6b2-ff39-4589-a1ae-196a7540e340 (dataset): DatasetConfig { id: 747dc6b2-ff39-4589-a1ae-196a7540e340 (dataset), name: DatasetName { pool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78355567-d757-4c6a-9bc3-6bda1276f9ae (dataset): DatasetConfig { id: 78355567-d757-4c6a-9bc3-6bda1276f9ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a303b8b-8513-4abf-9c39-48df1e1f77da (dataset): DatasetConfig { id: 7a303b8b-8513-4abf-9c39-48df1e1f77da (dataset), name: DatasetName { pool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7afbc0d5-6bc6-4753-9afd-38fb66ad3ac7 (dataset): DatasetConfig { id: 7afbc0d5-6bc6-4753-9afd-38fb66ad3ac7 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b0bfea2-9783-4bb7-b003-ad780859794d (dataset): DatasetConfig { id: 7b0bfea2-9783-4bb7-b003-ad780859794d (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b5fd4c0-f70a-4add-8501-072448518307 (dataset): DatasetConfig { id: 7b5fd4c0-f70a-4add-8501-072448518307 (dataset), name: DatasetName { pool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90efea0b-af94-41b7-be77-054b8760294c (dataset): DatasetConfig { id: 90efea0b-af94-41b7-be77-054b8760294c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92c14844-2fd4-4743-9470-780c9655a730 (dataset): DatasetConfig { id: 92c14844-2fd4-4743-9470-780c9655a730 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 976458f8-03d2-491c-8559-11062dfd458b (dataset): DatasetConfig { id: 976458f8-03d2-491c-8559-11062dfd458b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a758a6c-d9d2-4c61-858d-902cdf4a6948 (dataset): DatasetConfig { id: 9a758a6c-d9d2-4c61-858d-902cdf4a6948 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c1fe4b4-6556-415e-b617-ca84cd50e906 (dataset): DatasetConfig { id: 9c1fe4b4-6556-415e-b617-ca84cd50e906 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac179c83-b1a9-41e8-aaec-20e9aacaefb4 (dataset): DatasetConfig { id: ac179c83-b1a9-41e8-aaec-20e9aacaefb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b34f7937-5b58-48a4-8ed4-c4e7e4fdb81a (dataset): DatasetConfig { id: b34f7937-5b58-48a4-8ed4-c4e7e4fdb81a (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcf50f02-748d-4bc6-8852-aa5b58b032a2 (dataset): DatasetConfig { id: bcf50f02-748d-4bc6-8852-aa5b58b032a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c063772a-2337-4a0c-9361-9f2d996ec3e1 (dataset): DatasetConfig { id: c063772a-2337-4a0c-9361-9f2d996ec3e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4292e8d-43b2-451b-b2a4-cf764256e552 (dataset): DatasetConfig { id: c4292e8d-43b2-451b-b2a4-cf764256e552 (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca6dbb07-e576-479c-918e-50dc3f21d92f (dataset): DatasetConfig { id: ca6dbb07-e576-479c-918e-50dc3f21d92f (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd4d8c87-6017-4d77-983e-bdc0e4b09e35 (dataset): DatasetConfig { id: cd4d8c87-6017-4d77-983e-bdc0e4b09e35 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cde7a5d6-682e-49a3-a6bf-ab8e3b18497b (dataset): DatasetConfig { id: cde7a5d6-682e-49a3-a6bf-ab8e3b18497b (dataset), name: DatasetName { pool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce4f6e0f-9c7c-46c2-a508-89b69524f846 (dataset): DatasetConfig { id: ce4f6e0f-9c7c-46c2-a508-89b69524f846 (dataset), name: DatasetName { pool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d14a8839-1504-4898-a5a0-a30071305a92 (dataset): DatasetConfig { id: d14a8839-1504-4898-a5a0-a30071305a92 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3b49c36-04b0-41bd-8859-975276e19017 (dataset): DatasetConfig { id: d3b49c36-04b0-41bd-8859-975276e19017 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5dbffaa-6b14-4665-acf3-735e32df2696 (dataset): DatasetConfig { id: d5dbffaa-6b14-4665-acf3-735e32df2696 (dataset), name: DatasetName { pool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d667c4cd-e8eb-4ad1-a851-25dd58a21525 (dataset): DatasetConfig { id: d667c4cd-e8eb-4ad1-a851-25dd58a21525 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7149037-5978-4030-819a-0bc684508daf (dataset): DatasetConfig { id: d7149037-5978-4030-819a-0bc684508daf (dataset), name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8cd7586-12d7-40db-af4b-10c3085a3bed (dataset): DatasetConfig { id: d8cd7586-12d7-40db-af4b-10c3085a3bed (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7add4bc-f983-4288-a5d2-e889f594d408 (dataset): DatasetConfig { id: e7add4bc-f983-4288-a5d2-e889f594d408 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e96d825c-a2be-41a7-9143-c9a002790cea (dataset): DatasetConfig { id: e96d825c-a2be-41a7-9143-c9a002790cea (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eefb2074-1344-439e-8115-329b8b7bca1b (dataset): DatasetConfig { id: eefb2074-1344-439e-8115-329b8b7bca1b (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef75004e-a0bc-451b-8905-5e926f96bf30 (dataset): DatasetConfig { id: ef75004e-a0bc-451b-8905-5e926f96bf30 (dataset), name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2781556-f828-4874-aafa-f4ee0a682ee1 (dataset): DatasetConfig { id: f2781556-f828-4874-aafa-f4ee0a682ee1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f2acc426-8187-47fd-ac1a-470261f599ea (dataset): DatasetConfig { id: f2acc426-8187-47fd-ac1a-470261f599ea (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5c305ce-8447-4a3a-a892-73f7bf87bd7c (dataset): DatasetConfig { id: f5c305ce-8447-4a3a-a892-73f7bf87bd7c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8643f75-52e5-435a-9047-f51d30ff1ed4 (dataset): DatasetConfig { id: f8643f75-52e5-435a-9047-f51d30ff1ed4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4512024-12-21T06:11:34.579ZINFOSledAgent (StorageManager): No ledger in /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4522024-12-21T06:11:34.579ZINFOSledAgent (StorageManager): No ledger in /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4532024-12-21T06:11:34.579ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4542024-12-21T06:11:34.594ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552024-12-21T06:11:34.594ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4562024-12-21T06:11:34.594ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa" } file = sled-storage/src/manager.rs:1431
4572024-12-21T06:11:34.654ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582024-12-21T06:11:34.654ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4592024-12-21T06:11:34.654ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb" } file = sled-storage/src/manager.rs:1431
4602024-12-21T06:11:34.714ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612024-12-21T06:11:34.714ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4622024-12-21T06:11:34.714ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb" } file = sled-storage/src/manager.rs:1431
4632024-12-21T06:11:34.773ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642024-12-21T06:11:34.773ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4652024-12-21T06:11:34.773ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ddb0f817-6f83-4c52-9219-0328f60b3f24/crypt/debug"), full_name: "oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24/crypt/debug" } file = sled-storage/src/manager.rs:1431
4662024-12-21T06:11:34.802ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672024-12-21T06:11:34.802ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4682024-12-21T06:11:34.802ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/debug"), full_name: "oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/debug" } file = sled-storage/src/manager.rs:1431
4692024-12-21T06:11:34.831ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702024-12-21T06:11:34.831ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4712024-12-21T06:11:34.831ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/957b9893-852a-42fc-af5f-4cd146632a7e/crypt/debug"), full_name: "oxp_957b9893-852a-42fc-af5f-4cd146632a7e/crypt/debug" } file = sled-storage/src/manager.rs:1431
4722024-12-21T06:11:34.859ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4732024-12-21T06:11:34.859ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4742024-12-21T06:11:34.859ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4752024-12-21T06:11:34.908ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4762024-12-21T06:11:34.908ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4772024-12-21T06:11:34.908ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4782024-12-21T06:11:34.957ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4792024-12-21T06:11:34.958ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4802024-12-21T06:11:34.958ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/zone/oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59"), full_name: "oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/zone/oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59" } file = sled-storage/src/manager.rs:1431
4812024-12-21T06:11:35.020ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4822024-12-21T06:11:35.020ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4832024-12-21T06:11:35.020ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ddb0f817-6f83-4c52-9219-0328f60b3f24/crypt/zone"), full_name: "oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24/crypt/zone" } file = sled-storage/src/manager.rs:1431
4842024-12-21T06:11:35.049ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852024-12-21T06:11:35.049ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4862024-12-21T06:11:35.049ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone"), full_name: "oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone" } file = sled-storage/src/manager.rs:1431
4872024-12-21T06:11:35.078ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882024-12-21T06:11:35.078ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4892024-12-21T06:11:35.078ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/957b9893-852a-42fc-af5f-4cd146632a7e/crypt/zone/oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d"), full_name: "oxp_957b9893-852a-42fc-af5f-4cd146632a7e/crypt/zone/oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d" } file = sled-storage/src/manager.rs:1431
4902024-12-21T06:11:35.137ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4912024-12-21T06:11:35.137ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4922024-12-21T06:11:35.137ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crypt/zone/oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5"), full_name: "oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crypt/zone/oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5" } file = sled-storage/src/manager.rs:1431
4932024-12-21T06:11:35.196ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4942024-12-21T06:11:35.197ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4952024-12-21T06:11:35.197ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4962024-12-21T06:11:35.245ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4972024-12-21T06:11:35.246ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4982024-12-21T06:11:35.246ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4992024-12-21T06:11:35.297ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5002024-12-21T06:11:35.297ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5012024-12-21T06:11:35.297ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/debug"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/debug" } file = sled-storage/src/manager.rs:1431
5022024-12-21T06:11:35.325ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5032024-12-21T06:11:35.325ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5042024-12-21T06:11:35.325ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c50bda89-deae-4199-9adf-06dda470c3af/crypt/debug"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/debug" } file = sled-storage/src/manager.rs:1431
5052024-12-21T06:11:35.355ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5062024-12-21T06:11:35.355ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5072024-12-21T06:11:35.355ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/957b9893-852a-42fc-af5f-4cd146632a7e/crypt/zone"), full_name: "oxp_957b9893-852a-42fc-af5f-4cd146632a7e/crypt/zone" } file = sled-storage/src/manager.rs:1431
5082024-12-21T06:11:35.384ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5092024-12-21T06:11:35.384ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5102024-12-21T06:11:35.384ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crucible" } file = sled-storage/src/manager.rs:1431
5112024-12-21T06:11:35.431ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5122024-12-21T06:11:35.431ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5132024-12-21T06:11:35.431ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5142024-12-21T06:11:35.480ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152024-12-21T06:11:35.480ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5162024-12-21T06:11:35.480ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/debug"), full_name: "oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/debug" } file = sled-storage/src/manager.rs:1431
5172024-12-21T06:11:35.509ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182024-12-21T06:11:35.509ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5192024-12-21T06:11:35.509ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/debug"), full_name: "oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/debug" } file = sled-storage/src/manager.rs:1431
5202024-12-21T06:11:35.539ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212024-12-21T06:11:35.539ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5222024-12-21T06:11:35.539ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crucible" } file = sled-storage/src/manager.rs:1431
5232024-12-21T06:11:35.549ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63) file = sled-agent/src/probe_manager.rs:231 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
5242024-12-21T06:11:35.587ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252024-12-21T06:11:35.587ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262024-12-21T06:11:35.587ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible" } file = sled-storage/src/manager.rs:1431
5272024-12-21T06:11:35.636ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282024-12-21T06:11:35.636ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5292024-12-21T06:11:35.636ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone/oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7"), full_name: "oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone/oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7" } file = sled-storage/src/manager.rs:1431
5302024-12-21T06:11:35.696ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5312024-12-21T06:11:35.696ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5322024-12-21T06:11:35.696ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/zone"), full_name: "oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/zone" } file = sled-storage/src/manager.rs:1431
5332024-12-21T06:11:35.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5342024-12-21T06:11:35.726ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5352024-12-21T06:11:35.726ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e" } file = sled-storage/src/manager.rs:1431
5362024-12-21T06:11:35.787ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5372024-12-21T06:11:35.787ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5382024-12-21T06:11:35.787ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone/oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d"), full_name: "oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone/oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d" } file = sled-storage/src/manager.rs:1431
5392024-12-21T06:11:35.848ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5402024-12-21T06:11:35.848ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5412024-12-21T06:11:35.848ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/zone/oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31"), full_name: "oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/zone/oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31" } file = sled-storage/src/manager.rs:1431
5422024-12-21T06:11:35.907ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5432024-12-21T06:11:35.907ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5442024-12-21T06:11:35.908ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone" } file = sled-storage/src/manager.rs:1431
5452024-12-21T06:11:35.939ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5462024-12-21T06:11:35.939ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5472024-12-21T06:11:35.939ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/zone"), full_name: "oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5482024-12-21T06:11:35.969ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5492024-12-21T06:11:35.969ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5502024-12-21T06:11:35.969ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5512024-12-21T06:11:36.019ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5522024-12-21T06:11:36.019ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5532024-12-21T06:11:36.019ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_957b9893-852a-42fc-af5f-4cd146632a7e/crucible" } file = sled-storage/src/manager.rs:1431
5542024-12-21T06:11:36.065ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552024-12-21T06:11:36.066ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5562024-12-21T06:11:36.066ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a/crucible" } file = sled-storage/src/manager.rs:1431
5572024-12-21T06:11:36.112ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582024-12-21T06:11:36.112ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5592024-12-21T06:11:36.112ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/234eff41-ac4f-4fc4-9846-10ce5431a0b0/crypt/zone"), full_name: "oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0/crypt/zone" } file = sled-storage/src/manager.rs:1431
5602024-12-21T06:11:36.141ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612024-12-21T06:11:36.141ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5622024-12-21T06:11:36.141ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5632024-12-21T06:11:36.190ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642024-12-21T06:11:36.190ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5652024-12-21T06:11:36.190ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5662024-12-21T06:11:36.239ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672024-12-21T06:11:36.239ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5682024-12-21T06:11:36.239ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0/crucible" } file = sled-storage/src/manager.rs:1431
5692024-12-21T06:11:36.287ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702024-12-21T06:11:36.287ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5712024-12-21T06:11:36.287ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible" } file = sled-storage/src/manager.rs:1431
5722024-12-21T06:11:36.334ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732024-12-21T06:11:36.334ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742024-12-21T06:11:36.334ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65" } file = sled-storage/src/manager.rs:1431
5752024-12-21T06:11:36.394ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762024-12-21T06:11:36.394ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5772024-12-21T06:11:36.394ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/zone/oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b"), full_name: "oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/zone/oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b" } file = sled-storage/src/manager.rs:1431
5782024-12-21T06:11:36.454ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792024-12-21T06:11:36.454ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802024-12-21T06:11:36.454ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755" } file = sled-storage/src/manager.rs:1431
5812024-12-21T06:11:36.511ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822024-12-21T06:11:36.511ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5832024-12-21T06:11:36.511ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b" } file = sled-storage/src/manager.rs:1431
5842024-12-21T06:11:36.551ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63) file = sled-agent/src/probe_manager.rs:231 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
5852024-12-21T06:11:36.570ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862024-12-21T06:11:36.570ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5872024-12-21T06:11:36.570ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crucible" } file = sled-storage/src/manager.rs:1431
5882024-12-21T06:11:36.618ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892024-12-21T06:11:36.618ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5902024-12-21T06:11:36.618ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crypt/zone/oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd"), full_name: "oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crypt/zone/oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd" } file = sled-storage/src/manager.rs:1431
5912024-12-21T06:11:36.677ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922024-12-21T06:11:36.677ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5932024-12-21T06:11:36.677ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crypt/zone"), full_name: "oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5942024-12-21T06:11:36.705ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952024-12-21T06:11:36.705ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5962024-12-21T06:11:36.705ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665" } file = sled-storage/src/manager.rs:1431
5972024-12-21T06:11:36.765ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982024-12-21T06:11:36.765ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5992024-12-21T06:11:36.765ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone/oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), full_name: "oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone/oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77" } file = sled-storage/src/manager.rs:1431
6002024-12-21T06:11:36.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012024-12-21T06:11:36.825ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6022024-12-21T06:11:36.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone/oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2"), full_name: "oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone/oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2" } file = sled-storage/src/manager.rs:1431
6032024-12-21T06:11:36.884ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042024-12-21T06:11:36.884ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6052024-12-21T06:11:36.884ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone" } file = sled-storage/src/manager.rs:1431
6062024-12-21T06:11:36.915ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072024-12-21T06:11:36.915ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6082024-12-21T06:11:36.915ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ddb0f817-6f83-4c52-9219-0328f60b3f24/crypt/zone/oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65"), full_name: "oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24/crypt/zone/oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65" } file = sled-storage/src/manager.rs:1431
6092024-12-21T06:11:36.973ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102024-12-21T06:11:36.973ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112024-12-21T06:11:36.973ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/234eff41-ac4f-4fc4-9846-10ce5431a0b0/crypt/zone/oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f"), full_name: "oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0/crypt/zone/oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f" } file = sled-storage/src/manager.rs:1431
6122024-12-21T06:11:37.023ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 16.171633902s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
6132024-12-21T06:11:37.032ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142024-12-21T06:11:37.032ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152024-12-21T06:11:37.032ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a" } file = sled-storage/src/manager.rs:1431
6162024-12-21T06:11:37.088ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172024-12-21T06:11:37.089ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182024-12-21T06:11:37.089ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21" } file = sled-storage/src/manager.rs:1431
6192024-12-21T06:11:37.148ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202024-12-21T06:11:37.148ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212024-12-21T06:11:37.148ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24/crucible" } file = sled-storage/src/manager.rs:1431
6222024-12-21T06:11:37.195ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232024-12-21T06:11:37.195ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6242024-12-21T06:11:37.195ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/zone/oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30"), full_name: "oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/zone/oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30" } file = sled-storage/src/manager.rs:1431
6252024-12-21T06:11:37.256ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262024-12-21T06:11:37.256ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6272024-12-21T06:11:37.256ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone/oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d"), full_name: "oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/zone/oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d" } file = sled-storage/src/manager.rs:1431
6282024-12-21T06:11:37.315ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292024-12-21T06:11:37.315ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6302024-12-21T06:11:37.315ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/zone/oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847" } file = sled-storage/src/manager.rs:1431
6312024-12-21T06:11:37.376ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322024-12-21T06:11:37.376ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6332024-12-21T06:11:37.376ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crypt/debug"), full_name: "oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crypt/debug" } file = sled-storage/src/manager.rs:1431
6342024-12-21T06:11:37.404ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352024-12-21T06:11:37.404ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362024-12-21T06:11:37.404ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/zone/oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16"), full_name: "oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/zone/oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16" } file = sled-storage/src/manager.rs:1431
6372024-12-21T06:11:37.466ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382024-12-21T06:11:37.466ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392024-12-21T06:11:37.466ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6402024-12-21T06:11:37.516ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412024-12-21T06:11:37.516ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422024-12-21T06:11:37.516ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c50bda89-deae-4199-9adf-06dda470c3af/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6432024-12-21T06:11:37.553ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63) file = sled-agent/src/probe_manager.rs:231 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
6442024-12-21T06:11:37.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452024-12-21T06:11:37.569ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6462024-12-21T06:11:37.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/234eff41-ac4f-4fc4-9846-10ce5431a0b0/crypt/debug"), full_name: "oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0/crypt/debug" } file = sled-storage/src/manager.rs:1431
6472024-12-21T06:11:37.598ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482024-12-21T06:11:37.598ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6492024-12-21T06:11:37.598ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/zone/oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671" } file = sled-storage/src/manager.rs:1431
6502024-12-21T06:11:37.658ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6512024-12-21T06:11:37.659ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6522024-12-21T06:11:37.659ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/zone/oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9"), full_name: "oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/zone/oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9" } file = sled-storage/src/manager.rs:1431
6532024-12-21T06:11:37.719ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6542024-12-21T06:11:37.719ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6552024-12-21T06:11:37.719ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6562024-12-21T06:11:37.770ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6572024-12-21T06:11:37.770ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6582024-12-21T06:11:37.771ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
6592024-12-21T06:11:37.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3192461 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54879 req_id = 646e7f4c-6e6b-48dd-9a64-01e9484ba3b1 response_code = 200 uri = /datasets
6602024-12-21T06:11:37.803ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 068965c6-3480-4953-b57e-dd969abb2a21 (service), filesystem_pool: Some(ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: e4561faf-9014-49c3-a487-f7d3655c55fb (service), filesystem_pool: Some(ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 45c0a855-5592-491c-b7b3-470902319db2 (service), filesystem_pool: Some(ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6612024-12-21T06:11:37.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63639
6622024-12-21T06:11:37.803ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6632024-12-21T06:11:37.803ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6642024-12-21T06:11:37.812ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6652024-12-21T06:11:37.812ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: InternalDns }, responder: ... }
6662024-12-21T06:11:37.821ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6672024-12-21T06:11:37.821ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6682024-12-21T06:11:37.829ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692024-12-21T06:11:37.829ZINFOSledAgent (ServiceManager): No ledger in /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-zones.json file = common/src/ledger.rs:188
6702024-12-21T06:11:37.829ZINFOSledAgent (ServiceManager): No ledger in /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-zones.json file = common/src/ledger.rs:188
6712024-12-21T06:11:37.829ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722024-12-21T06:11:37.872ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6732024-12-21T06:11:37.872ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6742024-12-21T06:11:37.872ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6752024-12-21T06:11:37.925ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2 file = illumos-utils/src/zone.rs:325
6762024-12-21T06:11:37.928ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb file = illumos-utils/src/zone.rs:325
6772024-12-21T06:11:37.932ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21 file = illumos-utils/src/zone.rs:325
6782024-12-21T06:11:37.945ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2 file = illumos-utils/src/zone.rs:363
6792024-12-21T06:11:37.950ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb file = illumos-utils/src/zone.rs:363
6802024-12-21T06:11:37.957ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21 file = illumos-utils/src/zone.rs:363
6812024-12-21T06:11:38.555ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63) file = sled-agent/src/probe_manager.rs:231 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
6822024-12-21T06:11:39.527ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-12-21T06:11:39.527ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6842024-12-21T06:11:39.527ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2
6852024-12-21T06:11:40.014ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6862024-12-21T06:11:40.278ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16693396555453969317 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
6872024-12-21T06:11:40.278ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17259409943821695882 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
6882024-12-21T06:11:40.459ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6892024-12-21T06:11:40.459ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6902024-12-21T06:11:40.465ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6912024-12-21T06:11:40.465ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
6922024-12-21T06:11:40.496ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6932024-12-21T06:11:40.496ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6942024-12-21T06:11:40.496ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6952024-12-21T06:11:40.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2") failed: Property not found. retry in 40.473256ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2
6962024-12-21T06:11:40.508ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb
6972024-12-21T06:11:40.513ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21
6982024-12-21T06:11:40.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2") failed: Property not found. retry in 96.520285ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2
6992024-12-21T06:11:40.625ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
7002024-12-21T06:11:40.625ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
7012024-12-21T06:11:40.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb") failed: Property not found. retry in 50.052649ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb
7022024-12-21T06:11:40.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21") failed: Property not found. retry in 36.474022ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21
7032024-12-21T06:11:40.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2") failed: Property not found. retry in 124.046484ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2
7042024-12-21T06:11:40.671ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
7052024-12-21T06:11:40.671ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
7062024-12-21T06:11:40.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21") failed: Property not found. retry in 86.140511ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21
7072024-12-21T06:11:40.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb") failed: Property not found. retry in 69.614487ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb
7082024-12-21T06:11:40.793ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
7092024-12-21T06:11:40.793ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
7102024-12-21T06:11:40.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb") failed: Property not found. retry in 162.657584ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb
7112024-12-21T06:11:40.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2") failed: Property not found. retry in 379.822117ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2
7122024-12-21T06:11:40.833ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
7132024-12-21T06:11:40.833ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
7142024-12-21T06:11:40.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21") failed: Property not found. retry in 194.829894ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21
7152024-12-21T06:11:40.955ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
7162024-12-21T06:11:40.955ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
7172024-12-21T06:11:40.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb") failed: Property not found. retry in 458.046606ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb
7182024-12-21T06:11:41.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21") failed: Property not found. retry in 331.999872ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21
7192024-12-21T06:11:41.163ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
7202024-12-21T06:11:41.163ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7212024-12-21T06:11:41.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2") failed: Property not found. retry in 839.846651ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2
7222024-12-21T06:11:41.214ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7232024-12-21T06:11:41.246ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7242024-12-21T06:11:41.246ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7252024-12-21T06:11:41.247ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7262024-12-21T06:11:41.247ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7272024-12-21T06:11:41.284ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
7282024-12-21T06:11:41.341ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7292024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7302024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7312024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7322024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7332024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7342024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7352024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7362024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7372024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7382024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7392024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7402024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7412024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7422024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7432024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7442024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7452024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7462024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7472024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7482024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7492024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7502024-12-21T06:11:41.341ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7512024-12-21T06:11:41.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21") failed: Property not found. retry in 755.043163ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21
7522024-12-21T06:11:41.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb") failed: Property not found. retry in 517.555278ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb
7532024-12-21T06:11:41.478ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13226585348842622236 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
7542024-12-21T06:11:41.478ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14437650190339355793 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
7552024-12-21T06:11:41.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb") failed: Property not found. retry in 570.16806ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb
7562024-12-21T06:11:42.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2") failed: Property not found. retry in 1.331119326s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2
7572024-12-21T06:11:42.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21") failed: Property not found. retry in 1.108661451s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21
7582024-12-21T06:11:42.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb") failed: Property not found. retry in 1.493252221s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb
7592024-12-21T06:11:43.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21") failed: Property not found. retry in 1.242633459s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21
7602024-12-21T06:11:43.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2") failed: Property not found. retry in 1.091822943s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2
7612024-12-21T06:11:44.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb") failed: Property not found. retry in 1.468754133s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb
7622024-12-21T06:11:44.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2") failed: Property not found. retry in 1.136741203s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2
7632024-12-21T06:11:44.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21") failed: Property not found. retry in 527.398304ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21
7642024-12-21T06:11:45.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21") failed: Property not found. retry in 1.271598604s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21
7652024-12-21T06:11:46.354ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_45c0a855-5592-491c-b7b3-470902319db2
7662024-12-21T06:11:46.354ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_e4561faf-9014-49c3-a487-f7d3655c55fb
7672024-12-21T06:11:46.354ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_068965c6-3480-4953-b57e-dd969abb2a21
7682024-12-21T06:11:46.354ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692024-12-21T06:11:46.355ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7702024-12-21T06:11:46.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8552146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:63639 req_id = b6949e2b-4038-4706-8f0d-9b96567bc115 response_code = 204 uri = /omicron-zones
7712024-12-21T06:11:46.357ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722024-12-21T06:11:46.524ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 148.56356ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7732024-12-21T06:11:46.689ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742024-12-21T06:11:46.737ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7752024-12-21T06:11:46.789ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7762024-12-21T06:11:46.789ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7772024-12-21T06:11:46.821ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7782024-12-21T06:11:46.822ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7792024-12-21T06:11:46.822ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7802024-12-21T06:11:46.851ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 068965c6-3480-4953-b57e-dd969abb2a21 (service), filesystem_pool: Some(ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: e4561faf-9014-49c3-a487-f7d3655c55fb (service), filesystem_pool: Some(ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 45c0a855-5592-491c-b7b3-470902319db2 (service), filesystem_pool: Some(ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a269b196-6313-4df3-914a-eacae41b3ff9 (service), filesystem_pool: Some(ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 91dedc37-2547-4671-a8fb-90dd63c758de, kind: Service { id: a269b196-6313-4df3-914a-eacae41b3ff9 }, name: Name("ntp-a269b196-6313-4df3-914a-eacae41b3ff9"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 247])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7812024-12-21T06:11:46.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44965
7822024-12-21T06:11:46.851ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832024-12-21T06:11:46.851ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842024-12-21T06:11:46.863ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852024-12-21T06:11:46.863ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862024-12-21T06:11:46.872ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872024-12-21T06:11:46.872ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882024-12-21T06:11:46.882ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7892024-12-21T06:11:46.882ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-zones.json file = common/src/ledger.rs:177
7902024-12-21T06:11:46.883ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-zones.json file = common/src/ledger.rs:177
7912024-12-21T06:11:46.883ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7922024-12-21T06:11:46.895ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7932024-12-21T06:11:46.927ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7942024-12-21T06:11:46.928ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7952024-12-21T06:11:46.928ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7962024-12-21T06:11:46.958ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 185, 247]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7972024-12-21T06:11:46.958ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7982024-12-21T06:11:46.958ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7992024-12-21T06:11:46.958ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8002024-12-21T06:11:46.959ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8012024-12-21T06:11:46.959ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8022024-12-21T06:11:46.984ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9 file = illumos-utils/src/zone.rs:325
8032024-12-21T06:11:47.004ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9 file = illumos-utils/src/zone.rs:363
8042024-12-21T06:11:47.629ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8052024-12-21T06:11:47.629ZINFOSledAgent (ServiceManager): Booting oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9
8062024-12-21T06:11:47.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9") failed: Property not found. retry in 27.144972ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9
8072024-12-21T06:11:47.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9") failed: Property not found. retry in 114.783342ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9
8082024-12-21T06:11:47.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9") failed: Property not found. retry in 144.544033ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9
8092024-12-21T06:11:48.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9") failed: Property not found. retry in 406.975215ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9
8102024-12-21T06:11:48.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9") failed: Property not found. retry in 922.291116ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9
8112024-12-21T06:11:49.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9") failed: Property not found. retry in 1.43583159s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9
8122024-12-21T06:11:50.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16693396555453969317 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8132024-12-21T06:11:50.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17259409943821695882 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8142024-12-21T06:11:50.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9") failed: Property not found. retry in 731.758488ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9
8152024-12-21T06:11:51.480ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13226585348842622236 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8162024-12-21T06:11:51.480ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14437650190339355793 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8172024-12-21T06:11:51.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9") failed: Property not found. retry in 690.653166ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9
8182024-12-21T06:11:52.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9") failed: Property not found. retry in 832.87194ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9
8192024-12-21T06:11:53.187ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9
8202024-12-21T06:11:53.187ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8212024-12-21T06:11:53.187ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8222024-12-21T06:11:53.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6336737 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44965 req_id = 267ad981-02e4-4846-8b3f-9de90f01e56c response_code = 204 uri = /omicron-zones
8232024-12-21T06:11:53.190ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8242024-12-21T06:11:53.243ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8252024-12-21T06:11:53.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64932
8262024-12-21T06:11:53.252ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8272024-12-21T06:11:53.252ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8734 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64932 req_id = b4dbfe6f-28f7-40dd-a780-372f1e6c154f response_code = 500 uri = /timesync
8282024-12-21T06:11:53.254ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8292024-12-21T06:11:53.369ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8302024-12-21T06:11:53.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45019
8312024-12-21T06:11:57.377ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8322024-12-21T06:11:57.377ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008519 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45019 req_id = 2be97550-cd8c-4ff7-a558-cb4a4a7b4a87 response_code = 500 uri = /timesync
8332024-12-21T06:11:57.380ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4857527897493913252 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8342024-12-21T06:11:57.380ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17035451890335587558 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8352024-12-21T06:11:57.380ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 86201333132022142 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8362024-12-21T06:11:57.381ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8372024-12-21T06:11:57.579ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8382024-12-21T06:11:57.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46854
8392024-12-21T06:11:57.588ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8402024-12-21T06:11:57.588ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46854 req_id = e55ecaf5-7edd-4ceb-86fb-7ad6b8d62471 response_code = 500 uri = /timesync
8412024-12-21T06:11:57.590ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8422024-12-21T06:11:57.764ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8432024-12-21T06:11:57.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57536
8442024-12-21T06:12:01.803ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a269b196-6313-4df3-914a-eacae41b3ff9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8452024-12-21T06:12:01.803ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57536 req_id = 61a21e07-2b17-4ea8-a929-79a8bca7a11c response_code = 500 uri = /timesync
8462024-12-21T06:12:01.805ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13226585348842622236 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8472024-12-21T06:12:01.805ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14437650190339355793 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8482024-12-21T06:12:01.805ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16693396555453969317 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8492024-12-21T06:12:01.805ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17259409943821695882 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8502024-12-21T06:12:01.806ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8512024-12-21T06:12:01.953ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8522024-12-21T06:12:01.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39041
8532024-12-21T06:12:01.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9627 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39041 req_id = 605c18dc-76f3-42ce-a2de-106179358792 response_code = 200 uri = /timesync
8542024-12-21T06:12:01.966ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.119281985 } file = sled-agent/src/rack_setup/service.rs:743
8552024-12-21T06:12:01.966ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8562024-12-21T06:12:02.111ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8572024-12-21T06:12:02.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62726
8582024-12-21T06:12:02.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62726 req_id = 4a7017f1-2dfd-466a-b1e4-c1bdafccfaa8 response_code = 200 uri = /timesync
8592024-12-21T06:12:02.122ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.118856996 } file = sled-agent/src/rack_setup/service.rs:743
8602024-12-21T06:12:02.122ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8612024-12-21T06:12:02.477ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8622024-12-21T06:12:02.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61179
8632024-12-21T06:12:02.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61179 req_id = f71148f5-7fc5-4e3c-9a63-4341d0eb6fcd response_code = 200 uri = /timesync
8642024-12-21T06:12:02.488ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.11786747 } file = sled-agent/src/rack_setup/service.rs:743
8652024-12-21T06:12:02.488ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8662024-12-21T06:12:02.928ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8672024-12-21T06:12:02.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48125
8682024-12-21T06:12:02.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48125 req_id = 1b8e1dd1-4932-4e42-8be3-81768a27a9e9 response_code = 200 uri = /timesync
8692024-12-21T06:12:02.940ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.116827972 } file = sled-agent/src/rack_setup/service.rs:743
8702024-12-21T06:12:02.940ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8712024-12-21T06:12:03.225ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9348378992546706225 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8722024-12-21T06:12:03.225ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2722938581280749814 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
8732024-12-21T06:12:03.311ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8742024-12-21T06:12:03.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63655
8752024-12-21T06:12:03.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63655 req_id = 3a96c8ba-be4f-418b-8a63-eaeb3595f809 response_code = 200 uri = /timesync
8762024-12-21T06:12:03.322ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.115794346 } file = sled-agent/src/rack_setup/service.rs:743
8772024-12-21T06:12:03.322ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8782024-12-21T06:12:03.744ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8792024-12-21T06:12:03.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44506
8802024-12-21T06:12:03.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8841 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44506 req_id = 2dbbef38-12f8-4820-b66a-f0370b56df8f response_code = 200 uri = /timesync
8812024-12-21T06:12:03.755ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.114659943 } file = sled-agent/src/rack_setup/service.rs:743
8822024-12-21T06:12:03.755ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8832024-12-21T06:12:04.056ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8842024-12-21T06:12:04.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53550
8852024-12-21T06:12:04.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53550 req_id = 043adfa3-0443-4352-bcc2-3a6cf10a8ef1 response_code = 200 uri = /timesync
8862024-12-21T06:12:04.067ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.113815837 } file = sled-agent/src/rack_setup/service.rs:743
8872024-12-21T06:12:04.067ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8882024-12-21T06:12:04.892ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8892024-12-21T06:12:04.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63262
8902024-12-21T06:12:04.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7564 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63262 req_id = 7d3f5fc0-3fc6-40f2-a4bd-baf22c93400c response_code = 200 uri = /timesync
8912024-12-21T06:12:04.902ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761524.2804348, correction: 0.111559778 } file = sled-agent/src/rack_setup/service.rs:743
8922024-12-21T06:12:04.902ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8932024-12-21T06:12:05.613ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8942024-12-21T06:12:05.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51279
8952024-12-21T06:12:05.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8919 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51279 req_id = 24ecbf94-b74e-48b4-9f3c-e99b98d70f54 response_code = 200 uri = /timesync
8962024-12-21T06:12:05.625ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761524.2804348, correction: 0.109610282 } file = sled-agent/src/rack_setup/service.rs:743
8972024-12-21T06:12:05.625ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8982024-12-21T06:12:06.189ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8992024-12-21T06:12:06.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49340
9002024-12-21T06:12:06.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49340 req_id = eeb75d3f-6dac-4793-b686-ac7065db3d77 response_code = 200 uri = /timesync
9012024-12-21T06:12:06.201ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761525.352466, correction: 0.107881308 } file = sled-agent/src/rack_setup/service.rs:743
9022024-12-21T06:12:06.201ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9032024-12-21T06:12:07.427ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4857527897493913252 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9042024-12-21T06:12:07.427ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17035451890335587558 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9052024-12-21T06:12:07.427ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 86201333132022142 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9062024-12-21T06:12:07.575ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9072024-12-21T06:12:07.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64762
9082024-12-21T06:12:07.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7942 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64762 req_id = c04c9f36-4e04-471a-bf45-4691f92de96c response_code = 200 uri = /timesync
9092024-12-21T06:12:07.586ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761526.5048716, correction: 0.104006849 } file = sled-agent/src/rack_setup/service.rs:743
9102024-12-21T06:12:07.586ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9112024-12-21T06:12:08.309ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 313.79272ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9122024-12-21T06:12:08.860ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9132024-12-21T06:12:08.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52196
9142024-12-21T06:12:08.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52196 req_id = 70b83cb5-cdd6-4b4b-af2c-267198a9def7 response_code = 200 uri = /timesync
9152024-12-21T06:12:08.871ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761528.178941, correction: 0.100275345 } file = sled-agent/src/rack_setup/service.rs:743
9162024-12-21T06:12:08.871ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9172024-12-21T06:12:10.254ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9182024-12-21T06:12:10.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50575
9192024-12-21T06:12:10.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50575 req_id = f5699122-b033-4326-aeb3-de040a1ca544 response_code = 200 uri = /timesync
9202024-12-21T06:12:10.266ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761529.0741315, correction: 0.09650632 } file = sled-agent/src/rack_setup/service.rs:743
9212024-12-21T06:12:10.266ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9222024-12-21T06:12:10.722ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32784
9232024-12-21T06:12:10.722ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32784 req_id = 4ea8ef42-0ca8-4e80-8f61-8915c9e96618 response_code = 200 uri = /baseboard
9242024-12-21T06:12:11.835ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13226585348842622236 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9252024-12-21T06:12:11.835ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14437650190339355793 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9262024-12-21T06:12:11.835ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16693396555453969317 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9272024-12-21T06:12:11.835ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17259409943821695882 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9282024-12-21T06:12:12.319ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9292024-12-21T06:12:12.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33687
9302024-12-21T06:12:12.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8643 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33687 req_id = 5b99f20f-5eb7-4db6-9c35-3717fe57e90c response_code = 200 uri = /timesync
9312024-12-21T06:12:12.330ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761531.269851, correction: 0.090907268 } file = sled-agent/src/rack_setup/service.rs:743
9322024-12-21T06:12:12.330ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9332024-12-21T06:12:13.255ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9348378992546706225 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9342024-12-21T06:12:13.255ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2722938581280749814 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9352024-12-21T06:12:14.595ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9362024-12-21T06:12:14.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41286
9372024-12-21T06:12:14.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8831 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41286 req_id = 5caf286c-b550-4599-9af9-2ee55718b861 response_code = 200 uri = /timesync
9382024-12-21T06:12:14.606ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761533.7819552, correction: 0.084749177 } file = sled-agent/src/rack_setup/service.rs:743
9392024-12-21T06:12:14.606ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9402024-12-21T06:12:16.297ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9412024-12-21T06:12:16.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54260
9422024-12-21T06:12:16.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8610 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54260 req_id = 24156c56-d4e5-47ee-b00b-1d80b7785e68 response_code = 200 uri = /timesync
9432024-12-21T06:12:16.308ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761535.4482384, correction: 0.080142736 } file = sled-agent/src/rack_setup/service.rs:743
9442024-12-21T06:12:16.308ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9452024-12-21T06:12:17.456ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4857527897493913252 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9462024-12-21T06:12:17.456ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17035451890335587558 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9472024-12-21T06:12:17.456ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 86201333132022142 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9482024-12-21T06:12:19.287ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9492024-12-21T06:12:19.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35031
9502024-12-21T06:12:19.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9044 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35031 req_id = fba43876-9ce2-40c6-8cee-3215d9471807 response_code = 200 uri = /timesync
9512024-12-21T06:12:19.300ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761538.74147, correction: 0.072069362 } file = sled-agent/src/rack_setup/service.rs:743
9522024-12-21T06:12:19.300ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9532024-12-21T06:12:21.864ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13226585348842622236 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9542024-12-21T06:12:21.864ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14437650190339355793 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9552024-12-21T06:12:21.864ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16693396555453969317 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9562024-12-21T06:12:21.864ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17259409943821695882 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9572024-12-21T06:12:23.284ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9348378992546706225 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9582024-12-21T06:12:23.284ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2722938581280749814 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9592024-12-21T06:12:23.700ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 655.186272ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9602024-12-21T06:12:23.861ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9612024-12-21T06:12:23.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64851
9622024-12-21T06:12:23.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8953 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64851 req_id = 084a639d-d59b-4d96-9d6c-7a1221ccf1a6 response_code = 200 uri = /timesync
9632024-12-21T06:12:23.873ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761541.5673282, correction: 0.059712175 } file = sled-agent/src/rack_setup/service.rs:743
9642024-12-21T06:12:23.873ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9652024-12-21T06:12:26.875ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9662024-12-21T06:12:26.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46136
9672024-12-21T06:12:26.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8829 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46136 req_id = 051b3fb4-12b0-4261-9370-32766f7f932f response_code = 200 uri = /timesync
9682024-12-21T06:12:26.889ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761545.6382992, correction: 0.051689446 } file = sled-agent/src/rack_setup/service.rs:743
9692024-12-21T06:12:26.889ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9702024-12-21T06:12:27.486ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4857527897493913252 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9712024-12-21T06:12:27.486ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17035451890335587558 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9722024-12-21T06:12:27.486ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 86201333132022142 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
9732024-12-21T06:12:30.925ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9742024-12-21T06:12:30.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58568
9752024-12-21T06:12:30.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58568 req_id = d1120c2e-e6f2-4fe9-b2ac-864ec1b872bf response_code = 200 uri = /timesync
9762024-12-21T06:12:30.951ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1121716738, ip_addr: 66.220.10.2, stratum: 3, ref_time: 1734761549.7061524, correction: 0.040757537 } file = sled-agent/src/rack_setup/service.rs:743
9772024-12-21T06:12:30.951ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
9782024-12-21T06:12:30.981ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 068965c6-3480-4953-b57e-dd969abb2a21 (service), filesystem_pool: Some(ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: e4561faf-9014-49c3-a487-f7d3655c55fb (service), filesystem_pool: Some(ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 45c0a855-5592-491c-b7b3-470902319db2 (service), filesystem_pool: Some(ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a269b196-6313-4df3-914a-eacae41b3ff9 (service), filesystem_pool: Some(ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 91dedc37-2547-4671-a8fb-90dd63c758de, kind: Service { id: a269b196-6313-4df3-914a-eacae41b3ff9 }, name: Name("ntp-a269b196-6313-4df3-914a-eacae41b3ff9"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 247])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a (service), filesystem_pool: Some(ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3db8eae8-e83c-4d04-aba1-1093d0d4dc6e (service), filesystem_pool: Some(ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External } } } }, OmicronZoneConfig { id: b2a47b45-66f7-481c-bc4b-1ea53d8998d7 (service), filesystem_pool: Some(ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External } } } }, OmicronZoneConfig { id: d9fdcd91-797e-4f03-a1d9-db4702245f16 (service), filesystem_pool: Some(ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External } } } }, OmicronZoneConfig { id: 12c02529-ba8a-41aa-aea6-98423d1c78a5 (service), filesystem_pool: Some(ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9792024-12-21T06:12:30.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54781
9802024-12-21T06:12:30.982ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9812024-12-21T06:12:30.982ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9822024-12-21T06:12:30.993ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9832024-12-21T06:12:30.993ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: InternalDns }, responder: ... }
9842024-12-21T06:12:31.005ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9852024-12-21T06:12:31.005ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9862024-12-21T06:12:31.015ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9872024-12-21T06:12:31.015ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9882024-12-21T06:12:31.025ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9892024-12-21T06:12:31.025ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Cockroach }, responder: ... }
9902024-12-21T06:12:31.034ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9912024-12-21T06:12:31.034ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9922024-12-21T06:12:31.043ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9932024-12-21T06:12:31.043ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Cockroach }, responder: ... }
9942024-12-21T06:12:31.053ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9952024-12-21T06:12:31.053ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Cockroach }, responder: ... }
9962024-12-21T06:12:31.062ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9972024-12-21T06:12:31.062ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-zones.json file = common/src/ledger.rs:177
9982024-12-21T06:12:31.062ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-zones.json file = common/src/ledger.rs:177
9992024-12-21T06:12:31.062ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10002024-12-21T06:12:31.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10012024-12-21T06:12:31.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10022024-12-21T06:12:31.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10032024-12-21T06:12:31.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10042024-12-21T06:12:31.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10052024-12-21T06:12:31.236ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7 file = illumos-utils/src/zone.rs:325
10062024-12-21T06:12:31.241ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a file = illumos-utils/src/zone.rs:325
10072024-12-21T06:12:31.245ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16 file = illumos-utils/src/zone.rs:325
10082024-12-21T06:12:31.249ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e file = illumos-utils/src/zone.rs:325
10092024-12-21T06:12:31.254ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 file = illumos-utils/src/zone.rs:325
10102024-12-21T06:12:31.259ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7 file = illumos-utils/src/zone.rs:363
10112024-12-21T06:12:31.264ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a file = illumos-utils/src/zone.rs:363
10122024-12-21T06:12:31.269ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16 file = illumos-utils/src/zone.rs:363
10132024-12-21T06:12:31.273ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e file = illumos-utils/src/zone.rs:363
10142024-12-21T06:12:31.278ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 file = illumos-utils/src/zone.rs:363
10152024-12-21T06:12:34.654ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b2a47b45-66f7-481c-bc4b-1ea53d8998d7'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10162024-12-21T06:12:34.654ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10172024-12-21T06:12:34.742ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='12c02529-ba8a-41aa-aea6-98423d1c78a5'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10182024-12-21T06:12:34.743ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10192024-12-21T06:12:34.748ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3db8eae8-e83c-4d04-aba1-1093d0d4dc6e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10202024-12-21T06:12:34.748ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10212024-12-21T06:12:34.756ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10222024-12-21T06:12:34.756ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10232024-12-21T06:12:34.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 67.5813ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10242024-12-21T06:12:34.807ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d9fdcd91-797e-4f03-a1d9-db4702245f16'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10252024-12-21T06:12:34.808ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10262024-12-21T06:12:34.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 62.077185ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10272024-12-21T06:12:34.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 41.785441ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10282024-12-21T06:12:34.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 50.273865ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10292024-12-21T06:12:34.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 58.559555ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10302024-12-21T06:12:34.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 76.716982ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10312024-12-21T06:12:34.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 256.538903ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10322024-12-21T06:12:35.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 69.285539ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10332024-12-21T06:12:35.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 65.970162ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10342024-12-21T06:12:35.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 177.52654ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10352024-12-21T06:12:35.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 449.721605ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10362024-12-21T06:12:35.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 276.12873ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10372024-12-21T06:12:35.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 45.596593ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10382024-12-21T06:12:35.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 254.432354ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10392024-12-21T06:12:35.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 252.757249ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10402024-12-21T06:12:35.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 145.656777ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10412024-12-21T06:12:35.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 504.884179ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10422024-12-21T06:12:36.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 169.231031ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10432024-12-21T06:12:36.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 425.930271ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10442024-12-21T06:12:36.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 687.704872ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10452024-12-21T06:12:36.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 733.218046ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10462024-12-21T06:12:36.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 514.128353ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10472024-12-21T06:12:36.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 645.84089ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10482024-12-21T06:12:36.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 1.072211614s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10492024-12-21T06:12:36.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 962.31426ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10502024-12-21T06:12:36.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 1.019950286s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10512024-12-21T06:12:36.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 896.255269ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10522024-12-21T06:12:37.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 1.025187583s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10532024-12-21T06:12:37.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 1.053481476s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10542024-12-21T06:12:37.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 843.101252ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10552024-12-21T06:12:37.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 1.167467005s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10562024-12-21T06:12:37.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 1.015873111s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10572024-12-21T06:12:38.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 1.42310636s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10582024-12-21T06:12:38.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 1.203032011s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10592024-12-21T06:12:38.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 1.063796487s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10602024-12-21T06:12:38.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 872.793992ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10612024-12-21T06:12:38.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 631.177953ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10622024-12-21T06:12:39.433ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.279866378s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
10632024-12-21T06:12:39.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 1.417139143s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10642024-12-21T06:12:39.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 507.431172ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10652024-12-21T06:12:39.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 915.989077ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10662024-12-21T06:12:39.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 1.039673467s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10672024-12-21T06:12:39.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 768.562168ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10682024-12-21T06:12:40.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 716.34226ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10692024-12-21T06:12:40.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 619.591933ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10702024-12-21T06:12:40.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 631.544209ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10712024-12-21T06:12:40.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 1.216943349s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10722024-12-21T06:12:40.837ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43678
10732024-12-21T06:12:40.837ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43678 req_id = d0b07b73-15bf-4092-a8b1-34cde6a338bc response_code = 200 uri = /baseboard
10742024-12-21T06:12:40.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 503.015659ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10752024-12-21T06:12:41.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 1.06046689s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10762024-12-21T06:12:41.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 1.234675441s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10772024-12-21T06:12:41.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 963.347074ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10782024-12-21T06:12:41.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 1.065160535s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10792024-12-21T06:12:42.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 1.188910251s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10802024-12-21T06:12:42.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 568.305409ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10812024-12-21T06:12:42.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 1.092769913s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10822024-12-21T06:12:42.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 579.045141ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10832024-12-21T06:12:42.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 1.338667532s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10842024-12-21T06:12:42.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 1.156311665s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10852024-12-21T06:12:43.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 500.851831ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10862024-12-21T06:12:43.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 910.667102ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10872024-12-21T06:12:43.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 693.283614ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10882024-12-21T06:12:43.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 668.412302ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10892024-12-21T06:12:43.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 589.88289ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10902024-12-21T06:12:43.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 683.419993ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10912024-12-21T06:12:44.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 510.417321ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10922024-12-21T06:12:44.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 529.314103ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10932024-12-21T06:12:44.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 1.375531453s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
10942024-12-21T06:12:44.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 1.009564989s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
10952024-12-21T06:12:44.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 1.191458908s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
10962024-12-21T06:12:44.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 667.302024ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10972024-12-21T06:12:44.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 636.972635ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
10982024-12-21T06:12:45.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 939.841952ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
10992024-12-21T06:12:45.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7") failed: Property not found. retry in 1.177951228s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
11002024-12-21T06:12:45.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a") failed: Property not found. retry in 1.13783013s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
11012024-12-21T06:12:45.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16") failed: Property not found. retry in 1.423948092s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
11022024-12-21T06:12:45.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5") failed: Property not found. retry in 980.067453ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
11032024-12-21T06:12:46.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e") failed: Property not found. retry in 677.544698ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
11042024-12-21T06:12:47.043ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_b2a47b45-66f7-481c-bc4b-1ea53d8998d7
11052024-12-21T06:12:47.043ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a
11062024-12-21T06:12:47.043ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_d9fdcd91-797e-4f03-a1d9-db4702245f16
11072024-12-21T06:12:47.043ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_3db8eae8-e83c-4d04-aba1-1093d0d4dc6e
11082024-12-21T06:12:47.043ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5
11092024-12-21T06:12:47.043ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11102024-12-21T06:12:47.043ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11112024-12-21T06:12:47.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16021505 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54781 req_id = 415daf6f-cbb6-4105-be1c-055281dcc34d response_code = 204 uri = /omicron-zones
11122024-12-21T06:12:47.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38511
11132024-12-21T06:12:47.113ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 33280 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38511 req_id = 0cea3c99-56d6-4345-acb1-0dafdf30c851 response_code = 500 uri = /cockroachdb
11142024-12-21T06:12:47.114ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0cea3c99-56d6-4345-acb1-0dafdf30c851", "content-length": "124", "date": "Sat, 21 Dec 2024 06:12:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0cea3c99-56d6-4345-acb1-0dafdf30c851" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 73.200215ms
11152024-12-21T06:12:47.218ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 30122 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38511 req_id = 91c3337d-ae4d-4699-bae9-312c9f2d16fa response_code = 500 uri = /cockroachdb
11162024-12-21T06:12:47.218ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "91c3337d-ae4d-4699-bae9-312c9f2d16fa", "content-length": "124", "date": "Sat, 21 Dec 2024 06:12:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "91c3337d-ae4d-4699-bae9-312c9f2d16fa" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 126.86181ms
11172024-12-21T06:12:47.373ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27901 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38511 req_id = e6876d1a-7e8b-4290-bfe3-b6141a5d1efb response_code = 500 uri = /cockroachdb
11182024-12-21T06:12:47.373ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e6876d1a-7e8b-4290-bfe3-b6141a5d1efb", "content-length": "124", "date": "Sat, 21 Dec 2024 06:12:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e6876d1a-7e8b-4290-bfe3-b6141a5d1efb" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 188.854874ms
11192024-12-21T06:12:47.591ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27273 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38511 req_id = e8a6ce99-8f53-4790-91ed-8bc3e0c5b0a4 response_code = 500 uri = /cockroachdb
11202024-12-21T06:12:47.591ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e8a6ce99-8f53-4790-91ed-8bc3e0c5b0a4", "content-length": "124", "date": "Sat, 21 Dec 2024 06:12:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e8a6ce99-8f53-4790-91ed-8bc3e0c5b0a4" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 215.083125ms
11212024-12-21T06:12:47.833ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25846 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38511 req_id = 6e729955-198a-4dff-9873-392b32c786e5 response_code = 500 uri = /cockroachdb
11222024-12-21T06:12:47.833ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6e729955-198a-4dff-9873-392b32c786e5", "content-length": "124", "date": "Sat, 21 Dec 2024 06:12:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6e729955-198a-4dff-9873-392b32c786e5" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 176.955652ms
11232024-12-21T06:12:48.038ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26244 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38511 req_id = e3b9225a-643f-4ac9-801a-7d39f86a580e response_code = 500 uri = /cockroachdb
11242024-12-21T06:12:48.038ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e3b9225a-643f-4ac9-801a-7d39f86a580e", "content-length": "124", "date": "Sat, 21 Dec 2024 06:12:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e3b9225a-643f-4ac9-801a-7d39f86a580e" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 126.828853ms
11252024-12-21T06:12:48.191ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25570 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38511 req_id = 7087c749-f5f5-445e-b7ca-5629020ee819 response_code = 500 uri = /cockroachdb
11262024-12-21T06:12:48.191ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7087c749-f5f5-445e-b7ca-5629020ee819", "content-length": "124", "date": "Sat, 21 Dec 2024 06:12:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7087c749-f5f5-445e-b7ca-5629020ee819" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 426.461658ms
11272024-12-21T06:12:48.646ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38511 req_id = 3321eb3f-75d1-4cd4-bf29-e242c6a48f75 response_code = 500 uri = /cockroachdb
11282024-12-21T06:12:48.646ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3321eb3f-75d1-4cd4-bf29-e242c6a48f75", "content-length": "124", "date": "Sat, 21 Dec 2024 06:12:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3321eb3f-75d1-4cd4-bf29-e242c6a48f75" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 517.285169ms
11292024-12-21T06:12:49.192ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12c02529-ba8a-41aa-aea6-98423d1c78a5 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38511 req_id = f0f086fe-4e72-4090-8895-84dc1d8ac3dc response_code = 500 uri = /cockroachdb
11302024-12-21T06:12:49.192ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f0f086fe-4e72-4090-8895-84dc1d8ac3dc", "content-length": "124", "date": "Sat, 21 Dec 2024 06:12:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f0f086fe-4e72-4090-8895-84dc1d8ac3dc" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 477.664119ms
11312024-12-21T06:12:49.701ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3758
11322024-12-21T06:13:16.146ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
11332024-12-21T06:13:22.060ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
11342024-12-21T06:13:22.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32392361 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38511 req_id = a1199ad7-42b8-40dd-a2fe-4423229c038d response_code = 204 uri = /cockroachdb
11352024-12-21T06:13:22.067ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33226
11362024-12-21T06:13:22.069ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1355 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33226 req_id = 5074e3a1-2987-4dec-b242-d0a076308263 response_code = 200 uri = /baseboard
11372024-12-21T06:13:22.082ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.576036516s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
11382024-12-21T06:13:22.118ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 068965c6-3480-4953-b57e-dd969abb2a21 (service), filesystem_pool: Some(ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: e4561faf-9014-49c3-a487-f7d3655c55fb (service), filesystem_pool: Some(ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 45c0a855-5592-491c-b7b3-470902319db2 (service), filesystem_pool: Some(ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a269b196-6313-4df3-914a-eacae41b3ff9 (service), filesystem_pool: Some(ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 91dedc37-2547-4671-a8fb-90dd63c758de, kind: Service { id: a269b196-6313-4df3-914a-eacae41b3ff9 }, name: Name("ntp-a269b196-6313-4df3-914a-eacae41b3ff9"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 247])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: fe04a0df-c7ae-412c-8ddc-3fcb3c7d9f4a (service), filesystem_pool: Some(ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3db8eae8-e83c-4d04-aba1-1093d0d4dc6e (service), filesystem_pool: Some(ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External } } } }, OmicronZoneConfig { id: b2a47b45-66f7-481c-bc4b-1ea53d8998d7 (service), filesystem_pool: Some(ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External } } } }, OmicronZoneConfig { id: d9fdcd91-797e-4f03-a1d9-db4702245f16 (service), filesystem_pool: Some(ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External } } } }, OmicronZoneConfig { id: 12c02529-ba8a-41aa-aea6-98423d1c78a5 (service), filesystem_pool: Some(ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External } } } }, OmicronZoneConfig { id: 621b6995-ee70-406d-a9fd-e26a95427f65 (service), filesystem_pool: Some(ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa (service), filesystem_pool: Some(ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b (service), filesystem_pool: Some(ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 (service), filesystem_pool: Some(ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb (service), filesystem_pool: Some(ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 40f81c4f-7bfa-4222-940b-53f4f10b067d (service), filesystem_pool: Some(ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 572fe39f-838b-4eaf-a147-5a59fd37c671 (service), filesystem_pool: Some(ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 73de3cc1-3ef1-49dd-a375-198b4baa716b (service), filesystem_pool: Some(ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: ab90463f-29be-4894-9157-b8d3e84d7847 (service), filesystem_pool: Some(ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: a7d02745-e147-4ba0-b10a-8023dffdbf31 (service), filesystem_pool: Some(ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 4b86f130-a5d9-4145-8f79-ca7828e17755 (service), filesystem_pool: Some(ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External } } } }, OmicronZoneConfig { id: d184458a-d684-4d6d-9063-36f6c28f1665 (service), filesystem_pool: Some(ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External } } } }, OmicronZoneConfig { id: 5e92baa0-212b-4c8f-8d19-a15d0d95593d (service), filesystem_pool: Some(ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External } } } }, OmicronZoneConfig { id: b76c5e3a-4cff-41fc-a91e-113c2d7deb30 (service), filesystem_pool: Some(ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External } } } }, OmicronZoneConfig { id: 3046d2e3-04e3-4270-80aa-ca900ad00dfd (service), filesystem_pool: Some(ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External } } } }, OmicronZoneConfig { id: e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f (service), filesystem_pool: Some(ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External } } } }, OmicronZoneConfig { id: a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65 (service), filesystem_pool: Some(ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External } } } }, OmicronZoneConfig { id: bb9218ea-cb92-478f-b10b-6d0ba7a53c59 (service), filesystem_pool: Some(ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External } } } }, OmicronZoneConfig { id: 9726d2fa-e6c7-4f9f-8af4-7070a7d6692d (service), filesystem_pool: Some(ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11392024-12-21T06:13:22.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64614
11402024-12-21T06:13:22.120ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11412024-12-21T06:13:22.120ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11422024-12-21T06:13:22.135ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11432024-12-21T06:13:22.135ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: InternalDns }, responder: ... }
11442024-12-21T06:13:22.146ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11452024-12-21T06:13:22.146ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11462024-12-21T06:13:22.156ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11472024-12-21T06:13:22.156ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11482024-12-21T06:13:22.165ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11492024-12-21T06:13:22.165ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Cockroach }, responder: ... }
11502024-12-21T06:13:22.176ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11512024-12-21T06:13:22.176ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11522024-12-21T06:13:22.186ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11532024-12-21T06:13:22.186ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Cockroach }, responder: ... }
11542024-12-21T06:13:22.195ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11552024-12-21T06:13:22.195ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Cockroach }, responder: ... }
11562024-12-21T06:13:22.205ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11572024-12-21T06:13:22.205ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11582024-12-21T06:13:22.216ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11592024-12-21T06:13:22.216ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11602024-12-21T06:13:22.227ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11612024-12-21T06:13:22.227ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11622024-12-21T06:13:22.240ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11632024-12-21T06:13:22.240ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, kind: Crucible }, responder: ... }
11642024-12-21T06:13:22.250ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11652024-12-21T06:13:22.250ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, kind: Crucible }, responder: ... }
11662024-12-21T06:13:22.262ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11672024-12-21T06:13:22.262ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, kind: Crucible }, responder: ... }
11682024-12-21T06:13:22.271ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11692024-12-21T06:13:22.271ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, kind: Crucible }, responder: ... }
11702024-12-21T06:13:22.280ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11712024-12-21T06:13:22.280ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, kind: Crucible }, responder: ... }
11722024-12-21T06:13:22.289ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11732024-12-21T06:13:22.289ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, kind: Crucible }, responder: ... }
11742024-12-21T06:13:22.299ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11752024-12-21T06:13:22.299ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, kind: Crucible }, responder: ... }
11762024-12-21T06:13:22.310ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11772024-12-21T06:13:22.310ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, kind: Crucible }, responder: ... }
11782024-12-21T06:13:22.320ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11792024-12-21T06:13:22.320ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, kind: Crucible }, responder: ... }
11802024-12-21T06:13:22.330ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11812024-12-21T06:13:22.330ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-zones.json file = common/src/ledger.rs:177
11822024-12-21T06:13:22.331ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-zones.json file = common/src/ledger.rs:177
11832024-12-21T06:13:22.331ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11842024-12-21T06:13:22.444ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11852024-12-21T06:13:22.457ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11862024-12-21T06:13:22.510ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11872024-12-21T06:13:22.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11882024-12-21T06:13:22.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11892024-12-21T06:13:22.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11902024-12-21T06:13:22.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11912024-12-21T06:13:22.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11922024-12-21T06:13:22.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11932024-12-21T06:13:22.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11942024-12-21T06:13:22.512ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11952024-12-21T06:13:22.674ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11962024-12-21T06:13:22.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11972024-12-21T06:13:22.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11982024-12-21T06:13:22.731ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11992024-12-21T06:13:22.731ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12002024-12-21T06:13:22.731ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12012024-12-21T06:13:22.731ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12022024-12-21T06:13:22.731ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12032024-12-21T06:13:22.733ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d file = illumos-utils/src/zone.rs:325
12042024-12-21T06:13:22.738ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31 file = illumos-utils/src/zone.rs:325
12052024-12-21T06:13:22.743ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755 file = illumos-utils/src/zone.rs:325
12062024-12-21T06:13:22.749ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847 file = illumos-utils/src/zone.rs:325
12072024-12-21T06:13:22.754ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30 file = illumos-utils/src/zone.rs:325
12082024-12-21T06:13:22.759ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f file = illumos-utils/src/zone.rs:325
12092024-12-21T06:13:22.764ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b file = illumos-utils/src/zone.rs:325
12102024-12-21T06:13:22.901ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d file = illumos-utils/src/zone.rs:363
12112024-12-21T06:13:22.906ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31 file = illumos-utils/src/zone.rs:363
12122024-12-21T06:13:22.911ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755 file = illumos-utils/src/zone.rs:363
12132024-12-21T06:13:22.915ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847 file = illumos-utils/src/zone.rs:363
12142024-12-21T06:13:22.920ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30 file = illumos-utils/src/zone.rs:363
12152024-12-21T06:13:22.925ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f file = illumos-utils/src/zone.rs:363
12162024-12-21T06:13:22.931ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b file = illumos-utils/src/zone.rs:363
12172024-12-21T06:13:22.936ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665 file = illumos-utils/src/zone.rs:325
12182024-12-21T06:13:22.942ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d file = illumos-utils/src/zone.rs:325
12192024-12-21T06:13:22.948ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671 file = illumos-utils/src/zone.rs:325
12202024-12-21T06:13:22.953ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd file = illumos-utils/src/zone.rs:325
12212024-12-21T06:13:22.959ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59 file = illumos-utils/src/zone.rs:325
12222024-12-21T06:13:22.966ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65 file = illumos-utils/src/zone.rs:325
12232024-12-21T06:13:22.973ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d file = illumos-utils/src/zone.rs:325
12242024-12-21T06:13:22.982ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665 file = illumos-utils/src/zone.rs:363
12252024-12-21T06:13:22.988ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d file = illumos-utils/src/zone.rs:363
12262024-12-21T06:13:22.995ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671 file = illumos-utils/src/zone.rs:363
12272024-12-21T06:13:23.003ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd file = illumos-utils/src/zone.rs:363
12282024-12-21T06:13:23.014ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59 file = illumos-utils/src/zone.rs:363
12292024-12-21T06:13:23.023ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65 file = illumos-utils/src/zone.rs:363
12302024-12-21T06:13:23.036ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d file = illumos-utils/src/zone.rs:363
12312024-12-21T06:13:23.114ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12322024-12-21T06:13:23.186ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12332024-12-21T06:13:23.243ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12342024-12-21T06:13:23.302ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12352024-12-21T06:13:23.360ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12362024-12-21T06:13:23.370ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12372024-12-21T06:13:23.370ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12382024-12-21T06:13:23.428ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 134, 202]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12392024-12-21T06:13:23.428ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12402024-12-21T06:13:23.431ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12412024-12-21T06:13:23.431ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12422024-12-21T06:13:23.486ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 241, 116]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12432024-12-21T06:13:23.486ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12442024-12-21T06:13:23.487ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12452024-12-21T06:13:23.487ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12462024-12-21T06:13:23.542ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 253, 216]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12472024-12-21T06:13:23.542ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12482024-12-21T06:13:23.544ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12492024-12-21T06:13:23.544ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12502024-12-21T06:13:23.605ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 177, 183]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12512024-12-21T06:13:23.605ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12522024-12-21T06:13:23.606ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12532024-12-21T06:13:23.606ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12542024-12-21T06:13:23.684ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 149, 103]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12552024-12-21T06:13:23.684ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12562024-12-21T06:13:23.695ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12572024-12-21T06:13:23.695ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12582024-12-21T06:13:23.695ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
12592024-12-21T06:13:23.695ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
12602024-12-21T06:13:23.695ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12612024-12-21T06:13:23.695ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12622024-12-21T06:13:23.695ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
12632024-12-21T06:13:23.695ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
12642024-12-21T06:13:23.695ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12652024-12-21T06:13:23.695ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
12662024-12-21T06:13:23.700ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12672024-12-21T06:13:23.702ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12682024-12-21T06:13:23.745ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12692024-12-21T06:13:23.749ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12702024-12-21T06:13:23.749ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
12712024-12-21T06:13:23.754ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
12722024-12-21T06:13:23.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12732024-12-21T06:13:23.758ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
12742024-12-21T06:13:23.758ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12752024-12-21T06:13:23.762ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12762024-12-21T06:13:23.960ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b file = illumos-utils/src/zone.rs:325
12772024-12-21T06:13:23.971ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65 file = illumos-utils/src/zone.rs:325
12782024-12-21T06:13:23.981ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa file = illumos-utils/src/zone.rs:325
12792024-12-21T06:13:23.999ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb file = illumos-utils/src/zone.rs:325
12802024-12-21T06:13:24.009ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77 file = illumos-utils/src/zone.rs:325
12812024-12-21T06:13:24.022ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b file = illumos-utils/src/zone.rs:363
12822024-12-21T06:13:24.035ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65 file = illumos-utils/src/zone.rs:363
12832024-12-21T06:13:24.045ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa file = illumos-utils/src/zone.rs:363
12842024-12-21T06:13:24.056ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb file = illumos-utils/src/zone.rs:363
12852024-12-21T06:13:24.064ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77 file = illumos-utils/src/zone.rs:363
12862024-12-21T06:13:28.131ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0dd96e9e-4730-44c7-9359-c310dddb2710'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12872024-12-21T06:13:28.132ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
12882024-12-21T06:13:28.185ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dfe226ec-25b8-47a4-b4e1-b1f3c25882f7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12892024-12-21T06:13:28.185ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f4452719-1e46-4bcf-b2f0-cf5e5a97de9f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12902024-12-21T06:13:28.186ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ecdfc4ec-247c-4337-8c08-36af3f0708fa'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12912024-12-21T06:13:28.186ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_957b9893-852a-42fc-af5f-4cd146632a7e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3dad32a1-c024-47f7-b3ec-63a00b237182'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12922024-12-21T06:13:28.186ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
12932024-12-21T06:13:28.193ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
12942024-12-21T06:13:28.199ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
12952024-12-21T06:13:28.205ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
12962024-12-21T06:13:28.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 64.02824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
12972024-12-21T06:13:28.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 34.675002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
12982024-12-21T06:13:28.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 47.197772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
12992024-12-21T06:13:28.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 74.691641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
13002024-12-21T06:13:28.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 39.040567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
13012024-12-21T06:13:28.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 132.92641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
13022024-12-21T06:13:28.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 65.975661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
13032024-12-21T06:13:28.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 112.893381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
13042024-12-21T06:13:28.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 145.681402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
13052024-12-21T06:13:28.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 122.765865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
13062024-12-21T06:13:28.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 63.149606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
13072024-12-21T06:13:28.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 150.971672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
13082024-12-21T06:13:28.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 270.273666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
13092024-12-21T06:13:28.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 147.245444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
13102024-12-21T06:13:29.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 240.448686ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
13112024-12-21T06:13:29.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 464.769823ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
13122024-12-21T06:13:29.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 499.947105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
13132024-12-21T06:13:29.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 588.641627ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
13142024-12-21T06:13:29.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 391.972176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
13152024-12-21T06:13:29.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 236.410929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
13162024-12-21T06:13:29.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 839.725449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
13172024-12-21T06:13:29.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 1.13682182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
13182024-12-21T06:13:29.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 819.207281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
13192024-12-21T06:13:29.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 1.093180477s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
13202024-12-21T06:13:29.691ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='77140182-c03a-48ba-bc34-b3b63a86f33d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13212024-12-21T06:13:29.692ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
13222024-12-21T06:13:29.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 1.113628797s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
13232024-12-21T06:13:29.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 57.838648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
13242024-12-21T06:13:30.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 109.003005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
13252024-12-21T06:13:30.122ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13262024-12-21T06:13:30.123ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
13272024-12-21T06:13:30.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 126.044522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
13282024-12-21T06:13:30.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 209.880658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
13292024-12-21T06:13:30.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 58.083514ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
13302024-12-21T06:13:30.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 1.29630001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
13312024-12-21T06:13:30.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 54.459818ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
13322024-12-21T06:13:30.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 763.110476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
13332024-12-21T06:13:30.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 184.13536ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
13342024-12-21T06:13:30.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 911.4837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
13352024-12-21T06:13:30.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 945.056925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
13362024-12-21T06:13:30.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 557.228584ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
13372024-12-21T06:13:30.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 721.993089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
13382024-12-21T06:13:30.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 787.023999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
13392024-12-21T06:13:31.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 633.662563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
13402024-12-21T06:13:31.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 432.444169ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
13412024-12-21T06:13:31.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 1.061212581s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
13422024-12-21T06:13:31.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 838.101822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
13432024-12-21T06:13:31.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 1.385081524s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
13442024-12-21T06:13:31.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 1.096724422s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
13452024-12-21T06:13:31.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 1.32712958s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
13462024-12-21T06:13:31.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 1.273428803s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
13472024-12-21T06:13:31.808ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_13ee308e-c433-469e-b9ea-1dbf54a60851/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6b5bb293-f449-414d-b072-2ee1b675575e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13482024-12-21T06:13:31.808ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
13492024-12-21T06:13:31.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 758.593554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
13502024-12-21T06:13:31.874ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fdb2934d-c79c-4f9d-8a1c-f9eafb502a3b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13512024-12-21T06:13:31.875ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
13522024-12-21T06:13:31.914ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c50bda89-deae-4199-9adf-06dda470c3af/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bab9e686-32f4-4d58-bd73-0cb682778f4e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13532024-12-21T06:13:31.915ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
13542024-12-21T06:13:31.941ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552024-12-21T06:13:31.942ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
13562024-12-21T06:13:31.952ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13572024-12-21T06:13:31.953ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13582024-12-21T06:13:31.953ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
13592024-12-21T06:13:31.962ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
13602024-12-21T06:13:32.105ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13612024-12-21T06:13:32.106ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
13622024-12-21T06:13:32.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 52.918246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
13632024-12-21T06:13:32.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 31.988763ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
13642024-12-21T06:13:32.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 65.121262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
13652024-12-21T06:13:32.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 68.208588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
13662024-12-21T06:13:32.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 56.358793ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
13672024-12-21T06:13:32.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 27.364148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
13682024-12-21T06:13:32.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 91.255978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
13692024-12-21T06:13:32.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 41.178839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
13702024-12-21T06:13:32.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 198.991226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
13712024-12-21T06:13:32.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 109.475032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
13722024-12-21T06:13:32.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 76.889389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
13732024-12-21T06:13:32.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 139.745717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
13742024-12-21T06:13:32.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 134.902242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
13752024-12-21T06:13:32.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 162.227508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
13762024-12-21T06:13:32.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 1.492607038s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
13772024-12-21T06:13:32.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 59.861999ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
13782024-12-21T06:13:32.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 156.85423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
13792024-12-21T06:13:32.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 297.372749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
13802024-12-21T06:13:32.440ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='40f81c4f-7bfa-4222-940b-53f4f10b067d'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13812024-12-21T06:13:32.440ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
13822024-12-21T06:13:32.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 76.470038ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
13832024-12-21T06:13:32.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 337.788775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
13842024-12-21T06:13:32.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 238.022516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
13852024-12-21T06:13:32.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 181.867032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
13862024-12-21T06:13:32.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 339.466256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
13872024-12-21T06:13:32.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 207.770238ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
13882024-12-21T06:13:32.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 505.623518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
13892024-12-21T06:13:32.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 731.551849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
13902024-12-21T06:13:32.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 1.337179341s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
13912024-12-21T06:13:32.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 288.701691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
13922024-12-21T06:13:32.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 588.730037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
13932024-12-21T06:13:32.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 402.926567ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
13942024-12-21T06:13:32.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 465.598384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
13952024-12-21T06:13:32.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 635.199794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
13962024-12-21T06:13:32.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 411.615006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
13972024-12-21T06:13:32.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 1.341251938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
13982024-12-21T06:13:33.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 29.50803ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
13992024-12-21T06:13:33.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 1.339965334s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
14002024-12-21T06:13:33.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 751.475302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
14012024-12-21T06:13:33.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 148.18666ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
14022024-12-21T06:13:33.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 1.124666931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
14032024-12-21T06:13:33.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 925.332909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
14042024-12-21T06:13:33.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 847.498197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
14052024-12-21T06:13:33.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 225.295758ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
14062024-12-21T06:13:33.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 536.645546ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
14072024-12-21T06:13:33.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 703.734797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
14082024-12-21T06:13:33.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 586.972657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
14092024-12-21T06:13:33.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 417.520485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
14102024-12-21T06:13:33.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 316.421373ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
14112024-12-21T06:13:33.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 1.167750717s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
14122024-12-21T06:13:33.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 1.257305742s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
14132024-12-21T06:13:33.748ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14142024-12-21T06:13:33.753ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
14152024-12-21T06:13:33.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 769.147771ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
14162024-12-21T06:13:33.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 1.413614669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
14172024-12-21T06:13:33.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 1.085705224s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
14182024-12-21T06:13:33.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 975.415238ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
14192024-12-21T06:13:33.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 1.117602461s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
14202024-12-21T06:13:33.939ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14212024-12-21T06:13:33.940ZINFOSledAgent (ServiceManager): Booting oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
14222024-12-21T06:13:34.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 688.546824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
14232024-12-21T06:13:34.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 42.107739ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
14242024-12-21T06:13:34.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 1.469336942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
14252024-12-21T06:13:34.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 986.092749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
14262024-12-21T06:13:34.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 1.426403334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
14272024-12-21T06:13:34.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 138.761505ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
14282024-12-21T06:13:34.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 1.029353123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
14292024-12-21T06:13:34.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 1.235634868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
14302024-12-21T06:13:34.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 50.060929ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
14312024-12-21T06:13:34.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 148.22378ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
14322024-12-21T06:13:34.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 234.983808ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
14332024-12-21T06:13:34.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 1.046563977s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
14342024-12-21T06:13:34.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 513.901079ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
14352024-12-21T06:13:34.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 201.609797ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
14362024-12-21T06:13:34.500ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14372024-12-21T06:13:34.500ZINFOSledAgent (ServiceManager): Booting oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
14382024-12-21T06:13:34.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 470.518692ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
14392024-12-21T06:13:34.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 749.643456ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
14402024-12-21T06:13:34.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 594.744374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
14412024-12-21T06:13:34.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 805.699179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
14422024-12-21T06:13:34.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 304.437878ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
14432024-12-21T06:13:34.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 63.723413ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
14442024-12-21T06:13:34.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 77.747315ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
14452024-12-21T06:13:34.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 721.70644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
14462024-12-21T06:13:34.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 1.181798745s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
14472024-12-21T06:13:34.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 1.001777946s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
14482024-12-21T06:13:34.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 141.621587ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
14492024-12-21T06:13:35.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 1.415443263s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
14502024-12-21T06:13:35.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 993.283276ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
14512024-12-21T06:13:35.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 1.190526701s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
14522024-12-21T06:13:35.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 1.057319s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
14532024-12-21T06:13:35.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 417.156438ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
14542024-12-21T06:13:35.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 1.099143988s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
14552024-12-21T06:13:35.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 683.369589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
14562024-12-21T06:13:35.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 734.943095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
14572024-12-21T06:13:35.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 1.060416122s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
14582024-12-21T06:13:35.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 1.290451149s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
14592024-12-21T06:13:35.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 1.191936815s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
14602024-12-21T06:13:35.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 750.425452ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
14612024-12-21T06:13:35.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 1.085516489s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
14622024-12-21T06:13:35.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 929.820167ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
14632024-12-21T06:13:35.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 508.429071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
14642024-12-21T06:13:35.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 1.444309577s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
14652024-12-21T06:13:35.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 1.468895238s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
14662024-12-21T06:13:35.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 835.404726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
14672024-12-21T06:13:35.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 1.048866199s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
14682024-12-21T06:13:36.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 697.123498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
14692024-12-21T06:13:36.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 971.565277ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
14702024-12-21T06:13:36.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 1.095461529s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
14712024-12-21T06:13:36.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 823.051713ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
14722024-12-21T06:13:36.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 1.000881882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
14732024-12-21T06:13:36.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 1.435583017s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
14742024-12-21T06:13:36.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 1.015058225s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
14752024-12-21T06:13:36.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 1.455817731s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
14762024-12-21T06:13:36.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 1.163719077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
14772024-12-21T06:13:36.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 1.378999951s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
14782024-12-21T06:13:36.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 905.601714ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
14792024-12-21T06:13:36.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 626.267523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
14802024-12-21T06:13:36.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 749.807034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
14812024-12-21T06:13:36.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 1.369765747s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
14822024-12-21T06:13:36.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 786.739644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
14832024-12-21T06:13:36.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 597.226251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
14842024-12-21T06:13:36.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 875.417798ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
14852024-12-21T06:13:37.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 659.688172ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
14862024-12-21T06:13:37.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 841.981273ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
14872024-12-21T06:13:37.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 1.022065515s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
14882024-12-21T06:13:37.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 1.204006094s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
14892024-12-21T06:13:37.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 1.297238326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
14902024-12-21T06:13:37.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 1.399439725s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
14912024-12-21T06:13:37.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 1.158374128s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
14922024-12-21T06:13:37.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 612.818192ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
14932024-12-21T06:13:37.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 1.405349747s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
14942024-12-21T06:13:37.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 584.109818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
14952024-12-21T06:13:37.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 1.492147718s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
14962024-12-21T06:13:37.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 752.647433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
14972024-12-21T06:13:37.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 971.832333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
14982024-12-21T06:13:37.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 838.745929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
14992024-12-21T06:13:37.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 1.187126266s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
15002024-12-21T06:13:37.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 883.129701ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
15012024-12-21T06:13:37.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 1.226464386s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
15022024-12-21T06:13:37.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 1.092286422s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
15032024-12-21T06:13:37.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 1.421061426s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
15042024-12-21T06:13:37.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 1.078728667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
15052024-12-21T06:13:38.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 1.066834948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
15062024-12-21T06:13:38.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 833.071586ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
15072024-12-21T06:13:38.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 803.243039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
15082024-12-21T06:13:38.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 1.05230518s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
15092024-12-21T06:13:38.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 1.317217658s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
15102024-12-21T06:13:38.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 544.73416ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
15112024-12-21T06:13:38.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 1.448064941s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
15122024-12-21T06:13:38.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 748.93096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
15132024-12-21T06:13:38.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 714.687565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
15142024-12-21T06:13:38.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 806.026112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
15152024-12-21T06:13:38.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 1.029833053s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
15162024-12-21T06:13:38.849ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.561446331s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
15172024-12-21T06:13:38.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 1.335849686s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
15182024-12-21T06:13:38.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 947.455947ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
15192024-12-21T06:13:38.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 1.339255069s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
15202024-12-21T06:13:38.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 945.9946ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
15212024-12-21T06:13:38.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 898.022366ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
15222024-12-21T06:13:38.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 1.432439437s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
15232024-12-21T06:13:39.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 676.521025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
15242024-12-21T06:13:39.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 1.408912279s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
15252024-12-21T06:13:39.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 740.390815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
15262024-12-21T06:13:39.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 791.052745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
15272024-12-21T06:13:39.090ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15282024-12-21T06:13:39.090ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
15292024-12-21T06:13:39.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 610.108519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
15302024-12-21T06:13:39.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 806.400222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
15312024-12-21T06:13:39.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 1.390738501s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
15322024-12-21T06:13:39.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 55.203924ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
15332024-12-21T06:13:39.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 1.081510876s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
15342024-12-21T06:13:39.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 73.607934ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
15352024-12-21T06:13:39.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 1.19580239s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
15362024-12-21T06:13:39.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 165.311961ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
15372024-12-21T06:13:39.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 1.452559721s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
15382024-12-21T06:13:39.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 1.483245139s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
15392024-12-21T06:13:39.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 971.165034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
15402024-12-21T06:13:39.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 1.345420758s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
15412024-12-21T06:13:39.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 333.900776ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
15422024-12-21T06:13:39.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 1.120998665s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
15432024-12-21T06:13:39.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 1.281766402s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
15442024-12-21T06:13:39.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 1.413356544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
15452024-12-21T06:13:39.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 941.205906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
15462024-12-21T06:13:39.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 706.437249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
15472024-12-21T06:13:39.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 1.364611152s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
15482024-12-21T06:13:40.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 826.594037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
15492024-12-21T06:13:40.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 521.16085ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
15502024-12-21T06:13:40.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 999.503901ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
15512024-12-21T06:13:40.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 1.166436581s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
15522024-12-21T06:13:40.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 903.903696ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
15532024-12-21T06:13:40.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 755.479042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
15542024-12-21T06:13:40.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 952.447781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
15552024-12-21T06:13:40.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 856.555401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
15562024-12-21T06:13:40.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 1.173496318s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
15572024-12-21T06:13:40.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 1.472587037s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
15582024-12-21T06:13:40.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 1.321721983s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
15592024-12-21T06:13:40.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 1.259549391s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
15602024-12-21T06:13:40.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 1.220106227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
15612024-12-21T06:13:40.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 597.914247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
15622024-12-21T06:13:40.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 923.643754ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
15632024-12-21T06:13:41.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 1.12933681s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
15642024-12-21T06:13:41.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 929.521979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
15652024-12-21T06:13:41.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 1.443712598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
15662024-12-21T06:13:41.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 995.718142ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
15672024-12-21T06:13:41.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 711.076569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
15682024-12-21T06:13:41.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 1.369553703s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
15692024-12-21T06:13:41.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 819.372279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
15702024-12-21T06:13:41.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 767.474787ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
15712024-12-21T06:13:41.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 579.983775ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
15722024-12-21T06:13:41.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 806.781392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
15732024-12-21T06:13:41.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 993.809552ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
15742024-12-21T06:13:41.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 1.136779679s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
15752024-12-21T06:13:41.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 856.956143ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
15762024-12-21T06:13:41.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 1.09795162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
15772024-12-21T06:13:41.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 807.802865ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
15782024-12-21T06:13:41.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 594.816601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
15792024-12-21T06:13:41.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 875.52766ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
15802024-12-21T06:13:42.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 1.199545361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
15812024-12-21T06:13:42.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 1.177472947s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
15822024-12-21T06:13:42.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 1.068237289s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
15832024-12-21T06:13:42.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 1.451998201s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
15842024-12-21T06:13:42.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 1.032608794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
15852024-12-21T06:13:42.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 1.438018565s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
15862024-12-21T06:13:42.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 753.614275ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
15872024-12-21T06:13:42.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 1.313742599s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
15882024-12-21T06:13:42.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 1.402506336s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
15892024-12-21T06:13:42.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 751.168424ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
15902024-12-21T06:13:42.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 730.692526ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
15912024-12-21T06:13:42.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 562.538296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
15922024-12-21T06:13:42.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 784.057338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
15932024-12-21T06:13:42.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 825.679245ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
15942024-12-21T06:13:42.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 1.01888601s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
15952024-12-21T06:13:42.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 609.719838ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
15962024-12-21T06:13:42.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 575.25862ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
15972024-12-21T06:13:42.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 713.109472ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
15982024-12-21T06:13:43.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 910.677932ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
15992024-12-21T06:13:43.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 837.265244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
16002024-12-21T06:13:43.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 523.774616ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
16012024-12-21T06:13:43.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 695.225361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
16022024-12-21T06:13:43.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 612.51908ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
16032024-12-21T06:13:43.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 529.187176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
16042024-12-21T06:13:43.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 568.560693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
16052024-12-21T06:13:43.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 561.567319ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
16062024-12-21T06:13:43.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 1.462223344s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
16072024-12-21T06:13:43.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 827.922631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
16082024-12-21T06:13:43.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 1.060032498s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
16092024-12-21T06:13:43.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 1.372438251s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
16102024-12-21T06:13:43.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 959.853083ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
16112024-12-21T06:13:43.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 833.14271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
16122024-12-21T06:13:43.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 1.008109937s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
16132024-12-21T06:13:43.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 896.588357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
16142024-12-21T06:13:43.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 784.238599ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
16152024-12-21T06:13:43.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 722.807967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
16162024-12-21T06:13:43.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 939.45376ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16172024-12-21T06:13:43.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 1.138735834s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
16182024-12-21T06:13:43.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 1.187663812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
16192024-12-21T06:13:43.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 895.537381ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
16202024-12-21T06:13:43.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 1.414944453s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
16212024-12-21T06:13:43.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 1.271975998s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
16222024-12-21T06:13:43.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 819.115919ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
16232024-12-21T06:13:43.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 558.952605ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
16242024-12-21T06:13:43.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 1.076938487s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
16252024-12-21T06:13:44.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 1.302598545s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
16262024-12-21T06:13:44.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 985.116958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
16272024-12-21T06:13:44.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 1.44797015s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
16282024-12-21T06:13:44.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 587.603594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
16292024-12-21T06:13:44.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 518.963437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
16302024-12-21T06:13:44.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 1.394185323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
16312024-12-21T06:13:44.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 1.226879547s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
16322024-12-21T06:13:44.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 1.028439327s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
16332024-12-21T06:13:44.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 1.459385392s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
16342024-12-21T06:13:44.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 586.018772ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16352024-12-21T06:13:44.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 1.311136613s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
16362024-12-21T06:13:44.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 744.229424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
16372024-12-21T06:13:44.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 1.160733454s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
16382024-12-21T06:13:44.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 1.155010323s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
16392024-12-21T06:13:44.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 741.490986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
16402024-12-21T06:13:44.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f") failed: Property not found. retry in 1.329567834s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
16412024-12-21T06:13:44.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 1.093814979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
16422024-12-21T06:13:45.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 645.588475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
16432024-12-21T06:13:45.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d") failed: Property not found. retry in 1.284884682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
16442024-12-21T06:13:45.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 996.822037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
16452024-12-21T06:13:45.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 833.43774ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16462024-12-21T06:13:45.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 828.373277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
16472024-12-21T06:13:45.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30") failed: Property not found. retry in 1.416766086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
16482024-12-21T06:13:45.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d") failed: Property not found. retry in 1.245936891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
16492024-12-21T06:13:45.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65") failed: Property not found. retry in 949.648937ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
16502024-12-21T06:13:45.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 1.19356891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
16512024-12-21T06:13:45.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59") failed: Property not found. retry in 1.362154591s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
16522024-12-21T06:13:45.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65") failed: Property not found. retry in 1.007127726s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
16532024-12-21T06:13:45.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 594.735758ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
16542024-12-21T06:13:45.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d") failed: Property not found. retry in 1.193677376s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
16552024-12-21T06:13:45.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755") failed: Property not found. retry in 1.1000672s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
16562024-12-21T06:13:45.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd") failed: Property not found. retry in 1.469427358s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
16572024-12-21T06:13:46.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 1.238662547s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
16582024-12-21T06:13:46.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 802.044792ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
16592024-12-21T06:13:46.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 525.117964ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
16602024-12-21T06:13:46.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 569.948979ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16612024-12-21T06:13:46.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b") failed: Property not found. retry in 649.066504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
16622024-12-21T06:13:46.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 1.087124972s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
16632024-12-21T06:13:46.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31") failed: Property not found. retry in 941.022528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
16642024-12-21T06:13:46.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 1.25555551s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
16652024-12-21T06:13:46.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 1.11809103s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
16662024-12-21T06:13:46.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 700.114063ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16672024-12-21T06:13:47.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 924.5457ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
16682024-12-21T06:13:47.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665") failed: Property not found. retry in 1.390124306s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
16692024-12-21T06:13:47.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 893.268002ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
16702024-12-21T06:13:47.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847") failed: Property not found. retry in 737.546242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
16712024-12-21T06:13:47.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 1.358633715s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16722024-12-21T06:13:47.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77") failed: Property not found. retry in 933.280365ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
16732024-12-21T06:13:47.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb") failed: Property not found. retry in 1.369587413s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
16742024-12-21T06:13:48.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa") failed: Property not found. retry in 1.445510495s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
16752024-12-21T06:13:48.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b") failed: Property not found. retry in 684.379642ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
16762024-12-21T06:13:48.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 1.015739586s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16772024-12-21T06:13:49.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 706.387796ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16782024-12-21T06:13:50.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 1.485880199s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16792024-12-21T06:13:51.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 1.410601008s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16802024-12-21T06:13:52.115ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34644
16812024-12-21T06:13:52.118ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34644 req_id = 73639ea7-7521-4858-9dfc-6e96e300c550 response_code = 200 uri = /baseboard
16822024-12-21T06:13:53.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671") failed: Property not found. retry in 965.082668ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16832024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_fdd51b42-d0df-40d7-b6ac-9d3d0296650b
16842024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_621b6995-ee70-406d-a9fd-e26a95427f65
16852024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_40f81c4f-7bfa-4222-940b-53f4f10b067d
16862024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_a7d02745-e147-4ba0-b10a-8023dffdbf31
16872024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_4b86f130-a5d9-4145-8f79-ca7828e17755
16882024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_ab90463f-29be-4894-9157-b8d3e84d7847
16892024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_b76c5e3a-4cff-41fc-a91e-113c2d7deb30
16902024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_e4c8084c-2e55-4d07-8a38-2cd7a4e6f50f
16912024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_73de3cc1-3ef1-49dd-a375-198b4baa716b
16922024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa
16932024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
16942024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_d184458a-d684-4d6d-9063-36f6c28f1665
16952024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_5e92baa0-212b-4c8f-8d19-a15d0d95593d
16962024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_8507979d-3950-4f99-9dfb-8d7bc8f0ff77
16972024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_572fe39f-838b-4eaf-a147-5a59fd37c671
16982024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_3046d2e3-04e3-4270-80aa-ca900ad00dfd
16992024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_bb9218ea-cb92-478f-b10b-6d0ba7a53c59
17002024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_a3d82efb-29fa-4aa3-b91a-b8a0ef70ad65
17012024-12-21T06:13:54.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_9726d2fa-e6c7-4f9f-8af4-7070a7d6692d
17022024-12-21T06:13:54.399ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17032024-12-21T06:13:54.410ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17042024-12-21T06:13:54.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32305728 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64614 req_id = 0573696b-7d89-4203-9c92-de2c141a9765 response_code = 204 uri = /omicron-zones
17052024-12-21T06:13:54.443ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17062024-12-21T06:13:54.466ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17072024-12-21T06:13:54.473ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:802
17082024-12-21T06:13:54.507ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
17092024-12-21T06:13:54.512ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17102024-12-21T06:13:54.641ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17112024-12-21T06:13:54.742ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17122024-12-21T06:13:54.829ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17132024-12-21T06:13:55.003ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17142024-12-21T06:13:55.138ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17152024-12-21T06:13:55.460ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17162024-12-21T06:13:55.687ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17172024-12-21T06:13:55.904ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17182024-12-21T06:13:56.457ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17192024-12-21T06:13:56.855ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.402432705s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
17202024-12-21T06:13:57.051ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17212024-12-21T06:13:57.889ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/b4677cb0-5cb7-4375-8dec-b17ff2acf8f5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17222024-12-21T06:13:59.194ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1c556f1b-718d-4a71-9b58-d22496362938", "content-length": "173", "date": "Sat, 21 Dec 2024 06:13:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b4677cb0-5cb7-4375-8dec-b17ff2acf8f5\"", request_id: "1c556f1b-718d-4a71-9b58-d22496362938" } file = sled-agent/src/rack_setup/service.rs:1078
17232024-12-21T06:14:00.633ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8608d4aa-bba4-41b3-bcc6-f67aec2ef194", "content-length": "173", "date": "Sat, 21 Dec 2024 06:14:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b4677cb0-5cb7-4375-8dec-b17ff2acf8f5\"", request_id: "8608d4aa-bba4-41b3-bcc6-f67aec2ef194" } file = sled-agent/src/rack_setup/service.rs:1078
17242024-12-21T06:14:02.653ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "30d02237-9153-4038-8c20-ba33f1d499ed", "content-length": "173", "date": "Sat, 21 Dec 2024 06:14:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"cf7f8320-e45e-46f1-aa3b-b101ce937c63\"", request_id: "30d02237-9153-4038-8c20-ba33f1d499ed" } file = sled-agent/src/rack_setup/service.rs:1078
17252024-12-21T06:14:04.417ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "94152499-f671-4c59-8963-069051ef4471", "content-length": "173", "date": "Sat, 21 Dec 2024 06:14:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"cf7f8320-e45e-46f1-aa3b-b101ce937c63\"", request_id: "94152499-f671-4c59-8963-069051ef4471" } file = sled-agent/src/rack_setup/service.rs:1078
17262024-12-21T06:14:05.632ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4662f726-725c-42a9-a543-742cccac4e7f", "content-length": "173", "date": "Sat, 21 Dec 2024 06:14:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"cf7f8320-e45e-46f1-aa3b-b101ce937c63\"", request_id: "4662f726-725c-42a9-a543-742cccac4e7f" } file = sled-agent/src/rack_setup/service.rs:1078
17272024-12-21T06:14:06.204ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
17282024-12-21T06:14:06.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51709
17292024-12-21T06:14:06.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17302024-12-21T06:14:06.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17312024-12-21T06:14:06.297ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-zones.json file = common/src/ledger.rs:177
17322024-12-21T06:14:06.300ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-zones.json file = common/src/ledger.rs:177
17332024-12-21T06:14:06.313ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17342024-12-21T06:14:06.313ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6
17352024-12-21T06:14:06.341ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17362024-12-21T06:14:06.341ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c50bda89-deae-4199-9adf-06dda470c3af
17372024-12-21T06:14:06.366ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17382024-12-21T06:14:06.366ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_13ee308e-c433-469e-b9ea-1dbf54a60851
17392024-12-21T06:14:06.390ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17402024-12-21T06:14:06.390ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb
17412024-12-21T06:14:06.412ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17422024-12-21T06:14:06.413ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c
17432024-12-21T06:14:06.436ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17442024-12-21T06:14:06.436ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0
17452024-12-21T06:14:06.457ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17462024-12-21T06:14:06.457ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24
17472024-12-21T06:14:06.478ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17482024-12-21T06:14:06.478ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a
17492024-12-21T06:14:06.497ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17502024-12-21T06:14:06.497ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_957b9893-852a-42fc-af5f-4cd146632a7e
17512024-12-21T06:14:06.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218476 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51709 req_id = 3651b227-0048-4af5-90ec-f59c14f3125a response_code = 200 uri = /inventory
17522024-12-21T06:14:09.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46658
17532024-12-21T06:14:09.082ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17542024-12-21T06:14:09.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17552024-12-21T06:14:09.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17562024-12-21T06:14:09.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17572024-12-21T06:14:09.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17582024-12-21T06:14:09.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17592024-12-21T06:14:09.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17602024-12-21T06:14:09.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46658 req_id = 4eaed7ef-54a8-4c0e-92aa-062997fffd6d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17612024-12-21T06:14:09.085ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
17622024-12-21T06:14:09.088ZINFOSledAgent (RSS): Writing ledger to /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17632024-12-21T06:14:09.089ZINFOSledAgent (RSS): Writing ledger to /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17642024-12-21T06:14:09.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50986
17652024-12-21T06:14:09.366ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17662024-12-21T06:14:09.367ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17672024-12-21T06:14:09.367ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-zones.json file = common/src/ledger.rs:177
17682024-12-21T06:14:09.367ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-zones.json file = common/src/ledger.rs:177
17692024-12-21T06:14:09.378ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17702024-12-21T06:14:09.378ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6
17712024-12-21T06:14:09.404ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17722024-12-21T06:14:09.404ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c50bda89-deae-4199-9adf-06dda470c3af
17732024-12-21T06:14:09.430ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17742024-12-21T06:14:09.430ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_13ee308e-c433-469e-b9ea-1dbf54a60851
17752024-12-21T06:14:09.452ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17762024-12-21T06:14:09.453ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb
17772024-12-21T06:14:09.473ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17782024-12-21T06:14:09.473ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c
17792024-12-21T06:14:09.494ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17802024-12-21T06:14:09.494ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0
17812024-12-21T06:14:09.515ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17822024-12-21T06:14:09.515ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24
17832024-12-21T06:14:09.536ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17842024-12-21T06:14:09.536ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a
17852024-12-21T06:14:09.556ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17862024-12-21T06:14:09.557ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_957b9893-852a-42fc-af5f-4cd146632a7e
17872024-12-21T06:14:09.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201741 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50986 req_id = 4d069598-efe5-42b7-921d-4fd7291ad226 response_code = 200 uri = /inventory
17882024-12-21T06:14:10.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63892
17892024-12-21T06:14:10.314ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17902024-12-21T06:14:10.314ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17912024-12-21T06:14:10.314ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17922024-12-21T06:14:10.314ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17932024-12-21T06:14:10.314ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17942024-12-21T06:14:10.314ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17952024-12-21T06:14:10.314ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17962024-12-21T06:14:10.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63892 req_id = d2dfe99a-1b5a-40fa-b4ab-51ab98444d5e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17972024-12-21T06:14:10.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61155
17982024-12-21T06:14:10.349ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17992024-12-21T06:14:10.349ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18002024-12-21T06:14:10.349ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18012024-12-21T06:14:10.349ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18022024-12-21T06:14:10.349ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18032024-12-21T06:14:10.349ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18042024-12-21T06:14:10.349ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18052024-12-21T06:14:10.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61155 req_id = f9f0acca-25e7-4656-9393-81ea04f466de response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18062024-12-21T06:14:10.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36869
18072024-12-21T06:14:10.798ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18082024-12-21T06:14:10.798ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18092024-12-21T06:14:10.798ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18102024-12-21T06:14:10.798ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18112024-12-21T06:14:10.798ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18122024-12-21T06:14:10.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18132024-12-21T06:14:10.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18142024-12-21T06:14:10.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36869 req_id = a61d0049-c739-4206-b1a6-2d1702f65767 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18152024-12-21T06:14:15.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46180
18162024-12-21T06:14:15.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46180 req_id = dc6a9759-85b4-4659-bde9-f931655b758f response_code = 200 uri = /vpc-routes
18172024-12-21T06:14:15.972ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
18182024-12-21T06:14:15.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46180 req_id = f5a84766-c049-4e1e-8c13-04c227f2db17 response_code = 204 uri = /eip-gateways
18192024-12-21T06:14:16.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46180 req_id = 27b44ec3-66ed-4aec-86aa-2d52b6c14bb4 response_code = 204 uri = /vpc-routes
18202024-12-21T06:14:22.165ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38675
18212024-12-21T06:14:22.165ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38675 req_id = e1a8a4a2-3c0b-4319-83ac-cd7d05531f64 response_code = 200 uri = /baseboard
18222024-12-21T06:14:30.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57392
18232024-12-21T06:14:30.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57392 req_id = 863ed9a7-a77f-4d66-8f25-5035d0cac1bc response_code = 200 uri = /vpc-routes
18242024-12-21T06:14:30.544ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
18252024-12-21T06:14:30.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57392 req_id = b85888c4-5a6a-4fe9-ae48-8a4c049548a5 response_code = 204 uri = /eip-gateways
18262024-12-21T06:14:30.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57392 req_id = 6b08457d-c8b4-4e5e-a30a-00227d6c3890 response_code = 204 uri = /vpc-routes
18272024-12-21T06:14:30.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35850
18282024-12-21T06:14:30.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 822 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35850 req_id = 7bd583bb-1922-48d0-b809-69f177860f9f response_code = 200 uri = /v2p
18292024-12-21T06:14:30.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53849
18302024-12-21T06:14:30.817ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18312024-12-21T06:14:30.906ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18322024-12-21T06:14:30.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153324 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53849 req_id = 0f5e3da3-4a23-4f95-8885-827275dec6e6 response_code = 204 uri = /switch-ports
18332024-12-21T06:14:30.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53849 req_id = 574baa71-e21f-4a7b-9d2b-1b6323ee600c response_code = 200 uri = /network-bootstore-config
18342024-12-21T06:14:31.034ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
18352024-12-21T06:14:31.034ZINFOSledAgent (bootstore): Writing ledger to /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18362024-12-21T06:14:31.035ZINFOSledAgent (bootstore): Writing ledger to /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18372024-12-21T06:14:31.036ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
18382024-12-21T06:14:31.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53849 req_id = f753fb21-a583-41d5-b1c6-5c4a9a03a9ea response_code = 204 uri = /network-bootstore-config
18392024-12-21T06:14:31.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60603
18402024-12-21T06:14:31.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60603 req_id = 467d7d19-be75-4847-9402-60743461afa0 response_code = 200 uri = /vpc-routes
18412024-12-21T06:14:31.582ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
18422024-12-21T06:14:31.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60603 req_id = 81514da9-6e6e-4e32-9ac8-4f77ee620e6b response_code = 204 uri = /eip-gateways
18432024-12-21T06:14:31.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60603 req_id = e37ed8cf-a2fa-4b73-891a-a4546b1a2b61 response_code = 204 uri = /vpc-routes
18442024-12-21T06:14:31.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37639
18452024-12-21T06:14:31.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37639 req_id = 320456c6-9a2b-468f-9138-225ddac6e399 response_code = 200 uri = /v2p
18462024-12-21T06:14:31.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56256
18472024-12-21T06:14:31.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56256 req_id = ad419d8c-4477-4bb5-a821-4ffefbd8ddfd response_code = 200 uri = /vpc-routes
18482024-12-21T06:14:31.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35517
18492024-12-21T06:14:31.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35517 req_id = 26f30728-243b-4994-a6e1-450077edcd87 response_code = 200 uri = /v2p
18502024-12-21T06:14:31.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51616
18512024-12-21T06:14:31.780ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18522024-12-21T06:14:31.819ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18532024-12-21T06:14:31.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91288 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51616 req_id = 1edbedee-dc01-4be0-bdb8-b19f4a03d5d5 response_code = 204 uri = /switch-ports
18542024-12-21T06:14:31.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49956
18552024-12-21T06:14:31.871ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
18562024-12-21T06:14:31.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56256 req_id = 1f0813cc-f625-47a3-bb94-7ab6febe84c7 response_code = 204 uri = /eip-gateways
18572024-12-21T06:14:31.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51616 req_id = adf9f96f-350a-44e4-98d8-27a1bc7b6dce response_code = 200 uri = /network-bootstore-config
18582024-12-21T06:14:31.872ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18592024-12-21T06:14:31.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 488 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56256 req_id = 1a9c1340-656e-47a9-85b4-15c77c7046ca response_code = 204 uri = /vpc-routes
18602024-12-21T06:14:31.906ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18612024-12-21T06:14:31.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83288 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49956 req_id = 1884dba2-2286-48ef-9b7f-6bc56db367aa response_code = 204 uri = /switch-ports
18622024-12-21T06:14:31.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49956 req_id = 30c42c61-aae6-42a2-af4f-d8a44b0dcf6d response_code = 200 uri = /network-bootstore-config
18632024-12-21T06:14:43.979ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:35662 remote_addr = [fd00:1122:3344:101::d]:39776 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
18642024-12-21T06:14:44.006ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26231 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = a129d8c1-840a-4fc4-94db-7ba1aab346f9 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
18652024-12-21T06:14:52.201ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57466
18662024-12-21T06:14:52.201ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57466 req_id = 9b193927-5e5f-482b-ae26-facdfe80cdb3 response_code = 200 uri = /baseboard
18672024-12-21T06:15:00.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47139
18682024-12-21T06:15:00.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47139 req_id = 51839cec-5422-4998-9ad9-0575cccb0469 response_code = 200 uri = /vpc-routes
18692024-12-21T06:15:00.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40467
18702024-12-21T06:15:00.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40467 req_id = 008b4780-646d-4603-b6c0-40ac831cb1f9 response_code = 200 uri = /v2p
18712024-12-21T06:15:00.959ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
18722024-12-21T06:15:00.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47139 req_id = e5f21464-2e53-42f3-99cf-35ed316e4de6 response_code = 204 uri = /eip-gateways
18732024-12-21T06:15:00.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47139 req_id = 7bf0da79-6d7a-4206-b2b9-19473f88ab73 response_code = 204 uri = /vpc-routes
18742024-12-21T06:15:01.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41882
18752024-12-21T06:15:01.107ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18762024-12-21T06:15:01.158ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18772024-12-21T06:15:01.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170812 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41882 req_id = 289ed784-75fb-4d1b-a108-d9984236b5c3 response_code = 204 uri = /switch-ports
18782024-12-21T06:15:01.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41882 req_id = dc2178d6-e1dc-4a67-b690-41253dca31f1 response_code = 200 uri = /network-bootstore-config
18792024-12-21T06:15:01.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61179
18802024-12-21T06:15:01.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61179 req_id = f0cb96fd-4fae-49cb-b706-6b61eedbd85c response_code = 200 uri = /vpc-routes
18812024-12-21T06:15:01.647ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
18822024-12-21T06:15:01.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61179 req_id = 1d1b7d82-980c-4711-9790-873f1b905916 response_code = 204 uri = /eip-gateways
18832024-12-21T06:15:01.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53671
18842024-12-21T06:15:01.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53671 req_id = 38397022-d395-4e60-aff6-f1c9897fcc8b response_code = 200 uri = /vpc-routes
18852024-12-21T06:15:01.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61179 req_id = 165f6a6c-a2f7-4615-b313-13bbba5e58c9 response_code = 204 uri = /vpc-routes
18862024-12-21T06:15:01.749ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
18872024-12-21T06:15:01.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53671 req_id = d8c9aa9f-7a47-4fe5-b14c-10ce39b775f0 response_code = 204 uri = /eip-gateways
18882024-12-21T06:15:01.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53671 req_id = 9acb85e6-5aca-49c7-b4a7-89c5fa432d0e response_code = 204 uri = /vpc-routes
18892024-12-21T06:15:01.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36224
18902024-12-21T06:15:01.776ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18912024-12-21T06:15:01.833ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18922024-12-21T06:15:01.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187103 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36224 req_id = 349737cd-7f32-4d03-a452-481da248aa72 response_code = 204 uri = /switch-ports
18932024-12-21T06:15:01.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52997
18942024-12-21T06:15:01.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52997 req_id = fe6684f8-5cba-4a0d-9049-98d3119e14a2 response_code = 200 uri = /v2p
18952024-12-21T06:15:01.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36224 req_id = 4a52de19-468c-4f17-ac63-9781da233269 response_code = 200 uri = /network-bootstore-config
18962024-12-21T06:15:01.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44062
18972024-12-21T06:15:01.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44062 req_id = 57acb55b-4604-4796-8e5a-7463d00e2ad2 response_code = 200 uri = /v2p
18982024-12-21T06:15:02.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46210
18992024-12-21T06:15:02.168ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19002024-12-21T06:15:02.219ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19012024-12-21T06:15:02.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46210 req_id = 66617782-2916-41aa-951a-a8f87b3435d7 response_code = 204 uri = /switch-ports
19022024-12-21T06:15:02.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46210 req_id = 1e1af594-8ac1-4ede-aad9-f87d8144f759 response_code = 200 uri = /network-bootstore-config
19032024-12-21T06:15:13.988ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9123 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 10fe2d30-4326-4f8f-b18f-f413991a23a2 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
19042024-12-21T06:15:22.234ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64677
19052024-12-21T06:15:22.234ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64677 req_id = 9d62ddd5-f01b-41a0-8481-c719ebc76d38 response_code = 200 uri = /baseboard
19062024-12-21T06:15:30.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55443
19072024-12-21T06:15:30.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55443 req_id = 6fdef135-9678-47a4-b321-8f8b37ec6260 response_code = 200 uri = /vpc-routes
19082024-12-21T06:15:30.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59899
19092024-12-21T06:15:30.651ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19102024-12-21T06:15:30.688ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19112024-12-21T06:15:30.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95383 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59899 req_id = ed6883c2-c2ae-4188-812d-b069d49d21c0 response_code = 204 uri = /switch-ports
19122024-12-21T06:15:30.747ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
19132024-12-21T06:15:30.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55443 req_id = 99c6b5f3-eb17-4100-af9d-864b67981b72 response_code = 204 uri = /eip-gateways
19142024-12-21T06:15:30.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59899 req_id = 2b4c2bec-03dd-44a1-ad5c-432f7009c4de response_code = 200 uri = /network-bootstore-config
19152024-12-21T06:15:30.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55443 req_id = ff417a72-c71a-4988-8d5f-069a0833b726 response_code = 204 uri = /vpc-routes
19162024-12-21T06:15:30.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37352
19172024-12-21T06:15:30.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37352 req_id = e638b77d-2fa2-4514-b4fd-7867b46efd50 response_code = 200 uri = /v2p
19182024-12-21T06:15:31.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38279
19192024-12-21T06:15:31.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38279 req_id = 46e80b31-0b4c-48c4-bcd1-04e10f1d9c7a response_code = 200 uri = /vpc-routes
19202024-12-21T06:15:31.560ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
19212024-12-21T06:15:31.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38279 req_id = e39a23b7-e41b-4e66-98dc-6249ec69c89f response_code = 204 uri = /eip-gateways
19222024-12-21T06:15:31.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38279 req_id = ca860bec-d2c2-4fdb-87c1-98391df21ce7 response_code = 204 uri = /vpc-routes
19232024-12-21T06:15:31.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57499
19242024-12-21T06:15:31.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57499 req_id = 4fbb0e53-5598-4fc0-b7ea-c0401f1a7eb1 response_code = 200 uri = /v2p
19252024-12-21T06:15:31.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63098
19262024-12-21T06:15:31.666ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19272024-12-21T06:15:31.703ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19282024-12-21T06:15:31.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91508 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63098 req_id = 7953f64d-8e07-49a1-aee3-76a57220f49e response_code = 204 uri = /switch-ports
19292024-12-21T06:15:31.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58693
19302024-12-21T06:15:31.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58693 req_id = d262c8d8-2ced-4633-bdb2-b644b89c4728 response_code = 200 uri = /vpc-routes
19312024-12-21T06:15:31.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63098 req_id = 963ac6cc-a7a9-491b-b0f6-ae7310fee4fe response_code = 200 uri = /network-bootstore-config
19322024-12-21T06:15:31.807ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
19332024-12-21T06:15:31.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58693 req_id = a316d489-d3fe-4c47-ba25-6501d45194c7 response_code = 204 uri = /eip-gateways
19342024-12-21T06:15:31.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37407
19352024-12-21T06:15:31.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37407 req_id = 49ba4e62-5a7e-43f4-ab75-d6b81c7218cd response_code = 200 uri = /v2p
19362024-12-21T06:15:31.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58693 req_id = 62e3a675-47f0-4108-b6d0-61a595cefb6f response_code = 204 uri = /vpc-routes
19372024-12-21T06:15:31.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35032
19382024-12-21T06:15:31.871ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19392024-12-21T06:15:31.907ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19402024-12-21T06:15:31.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92158 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35032 req_id = 6841e530-fd0b-48bc-bcb6-3bdeec61c95b response_code = 204 uri = /switch-ports
19412024-12-21T06:15:31.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35032 req_id = 24a10edc-9d04-4c96-8d6a-83c7e550d0e0 response_code = 200 uri = /network-bootstore-config
19422024-12-21T06:15:43.987ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8944 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = f000d735-640c-41a1-8286-7722e39d18ff response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
19432024-12-21T06:15:52.267ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62973
19442024-12-21T06:15:52.268ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62973 req_id = 4f532918-515e-4ffe-910e-ed0529581afd response_code = 200 uri = /baseboard
19452024-12-21T06:16:00.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48596
19462024-12-21T06:16:00.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48596 req_id = 5884a9bb-3e8b-4101-ab17-b94a85c4b558 response_code = 200 uri = /vpc-routes
19472024-12-21T06:16:00.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
19482024-12-21T06:16:00.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48596 req_id = e03be1bd-8945-4407-857d-cd136e64db22 response_code = 204 uri = /eip-gateways
19492024-12-21T06:16:00.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48596 req_id = 2a6eb33a-562b-48ae-9b44-7ef06902a3ff response_code = 204 uri = /vpc-routes
19502024-12-21T06:16:00.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38242
19512024-12-21T06:16:00.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38242 req_id = d75df464-055d-4090-af33-c155db29ea6e response_code = 200 uri = /v2p
19522024-12-21T06:16:00.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59773
19532024-12-21T06:16:00.863ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19542024-12-21T06:16:00.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19552024-12-21T06:16:00.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88874 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59773 req_id = 444e2499-284d-43f6-a79e-81ea1ff51062 response_code = 204 uri = /switch-ports
19562024-12-21T06:16:00.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59773 req_id = 4d325825-39d9-498c-b2a4-c3bc9a75dc03 response_code = 200 uri = /network-bootstore-config
19572024-12-21T06:16:01.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34495
19582024-12-21T06:16:01.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34495 req_id = 09fb34ab-9c5a-4ed8-be35-3c6aa0ae7091 response_code = 200 uri = /vpc-routes
19592024-12-21T06:16:01.680ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
19602024-12-21T06:16:01.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34495 req_id = 17cf8cd1-9c39-4b79-b30b-4d534abce1a7 response_code = 204 uri = /eip-gateways
19612024-12-21T06:16:01.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34495 req_id = afc810a0-15a4-46b3-b4a2-08f989ebcbc9 response_code = 204 uri = /vpc-routes
19622024-12-21T06:16:01.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39430
19632024-12-21T06:16:01.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39430 req_id = d691d45b-8b4d-4c12-89f7-deba867af294 response_code = 200 uri = /v2p
19642024-12-21T06:16:01.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43922
19652024-12-21T06:16:01.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43922 req_id = 732260e9-f6f5-4146-9392-e57143b5f850 response_code = 200 uri = /v2p
19662024-12-21T06:16:01.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40001
19672024-12-21T06:16:01.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40001 req_id = 3eda4ec4-1e4c-407c-86b3-57f890bdf8c0 response_code = 200 uri = /vpc-routes
19682024-12-21T06:16:01.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57778
19692024-12-21T06:16:01.894ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19702024-12-21T06:16:01.933ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19712024-12-21T06:16:01.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95050 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57778 req_id = d8961ba7-6141-4c55-9de8-3c63d5a0f0d1 response_code = 204 uri = /switch-ports
19722024-12-21T06:16:01.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53528
19732024-12-21T06:16:01.989ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
19742024-12-21T06:16:01.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40001 req_id = cd36cad5-4af6-409f-afc0-06514f6d8d21 response_code = 204 uri = /eip-gateways
19752024-12-21T06:16:01.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57778 req_id = 14cde521-66b9-45ff-ab80-55f4f0278516 response_code = 200 uri = /network-bootstore-config
19762024-12-21T06:16:01.990ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19772024-12-21T06:16:02.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40001 req_id = 1d465474-cf5e-4e63-9d55-f3bb86a94b3b response_code = 204 uri = /vpc-routes
19782024-12-21T06:16:02.028ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19792024-12-21T06:16:02.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53528 req_id = 6c3bf080-e208-4146-9e80-63011fae4d0a response_code = 204 uri = /switch-ports
19802024-12-21T06:16:02.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53528 req_id = 799af056-3827-4f6e-9feb-9d824332044f response_code = 200 uri = /network-bootstore-config
19812024-12-21T06:16:13.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6933 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 08d915c7-b3ac-4e8a-a855-aa6d03210485 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
19822024-12-21T06:16:22.303ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57523
19832024-12-21T06:16:22.303ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57523 req_id = 38ed22ef-6553-424a-ac54-91135e50dab9 response_code = 200 uri = /baseboard
19842024-12-21T06:16:30.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62942
19852024-12-21T06:16:30.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62942 req_id = 1fb46866-556f-4da3-a893-493434192493 response_code = 200 uri = /vpc-routes
19862024-12-21T06:16:30.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
19872024-12-21T06:16:30.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62942 req_id = 88c69909-195d-4dbd-8b90-8a84d8879959 response_code = 204 uri = /eip-gateways
19882024-12-21T06:16:30.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62942 req_id = 300d8364-db60-4318-8639-148255d0f8a5 response_code = 204 uri = /vpc-routes
19892024-12-21T06:16:30.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56840
19902024-12-21T06:16:30.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56840 req_id = d0b3cb14-a47e-4454-9d1d-bcfcc58c7f58 response_code = 200 uri = /v2p
19912024-12-21T06:16:30.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46666
19922024-12-21T06:16:30.665ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19932024-12-21T06:16:30.701ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19942024-12-21T06:16:30.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89973 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46666 req_id = a1653fd2-c1ff-401c-a5b9-a4c751aba85a response_code = 204 uri = /switch-ports
19952024-12-21T06:16:30.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46666 req_id = 9160bdcc-c2ac-435d-940e-338c7b67267f response_code = 200 uri = /network-bootstore-config
19962024-12-21T06:16:31.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46596
19972024-12-21T06:16:31.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46596 req_id = a349ced5-f46f-4433-bc74-18a769acd0e8 response_code = 200 uri = /vpc-routes
19982024-12-21T06:16:31.570ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
19992024-12-21T06:16:31.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46596 req_id = a221a152-2d17-4040-ab2a-61cea51fec1a response_code = 204 uri = /eip-gateways
20002024-12-21T06:16:31.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48707
20012024-12-21T06:16:31.629ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20022024-12-21T06:16:31.665ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20032024-12-21T06:16:31.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93739 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48707 req_id = 2c1bff6e-af07-4b24-b157-653f2e13beb5 response_code = 204 uri = /switch-ports
20042024-12-21T06:16:31.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53684
20052024-12-21T06:16:31.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48166
20062024-12-21T06:16:31.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48707 req_id = 0f7186ff-345e-4de3-aa21-70a11d99b3b1 response_code = 200 uri = /network-bootstore-config
20072024-12-21T06:16:31.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 493 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46596 req_id = d3b46711-0c86-406b-a00d-61305d7d36d9 response_code = 204 uri = /vpc-routes
20082024-12-21T06:16:31.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48166 req_id = 47ad4113-5395-432e-922c-2b0c689d747f response_code = 200 uri = /vpc-routes
20092024-12-21T06:16:31.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53684 req_id = 6300ca0b-143e-4d82-bf60-7edd7bc598a7 response_code = 200 uri = /v2p
20102024-12-21T06:16:31.742ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
20112024-12-21T06:16:31.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48166 req_id = c8adbc0b-c420-41f9-b16d-b58d12b8e55e response_code = 204 uri = /eip-gateways
20122024-12-21T06:16:31.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45915
20132024-12-21T06:16:31.764ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20142024-12-21T06:16:31.802ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20152024-12-21T06:16:31.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92285 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45915 req_id = 4b0b21fc-38b2-4879-b7a0-bc7b94625109 response_code = 204 uri = /switch-ports
20162024-12-21T06:16:31.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53163
20172024-12-21T06:16:31.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45915 req_id = 61e8d737-ca3a-4aa9-be82-c70fce6e001b response_code = 200 uri = /network-bootstore-config
20182024-12-21T06:16:31.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 456 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48166 req_id = e9fcb74d-663f-4ec9-868b-19cdbca8de54 response_code = 204 uri = /vpc-routes
20192024-12-21T06:16:31.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53163 req_id = 84af93c8-42af-412c-83f9-5475ea6db17d response_code = 200 uri = /v2p
20202024-12-21T06:16:34.697ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20212024-12-21T06:16:43.987ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8964 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = af1d1e0c-39cb-42be-bd02-d098934bc9e2 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
20222024-12-21T06:16:52.336ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48918
20232024-12-21T06:16:52.336ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48918 req_id = b01d20d7-d5bc-4bfe-bb89-0a816f7846d3 response_code = 200 uri = /baseboard
20242024-12-21T06:17:00.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59352
20252024-12-21T06:17:00.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59352 req_id = 6266a072-b05f-495e-be0d-c7de8c46452c response_code = 200 uri = /vpc-routes
20262024-12-21T06:17:00.733ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
20272024-12-21T06:17:00.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59352 req_id = 7e814a84-dbcb-4540-8b22-11a2657ce0e3 response_code = 204 uri = /eip-gateways
20282024-12-21T06:17:00.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48018
20292024-12-21T06:17:00.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48018 req_id = 82ee325a-10e0-488b-b79f-bb6dbbc778a1 response_code = 200 uri = /v2p
20302024-12-21T06:17:00.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59352 req_id = f358ba64-1adf-4487-bb36-ea4dd7308f87 response_code = 204 uri = /vpc-routes
20312024-12-21T06:17:00.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40968
20322024-12-21T06:17:00.898ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20332024-12-21T06:17:00.936ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20342024-12-21T06:17:00.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40968 req_id = 438181fd-b141-4259-bdc6-37f51dd0716a response_code = 204 uri = /switch-ports
20352024-12-21T06:17:00.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40968 req_id = 775d371b-a7b3-4e16-8547-ff03fd42317d response_code = 200 uri = /network-bootstore-config
20362024-12-21T06:17:01.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64416
20372024-12-21T06:17:01.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64416 req_id = 29b52151-d451-42ab-8d09-e6ec5b979f29 response_code = 200 uri = /vpc-routes
20382024-12-21T06:17:01.779ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
20392024-12-21T06:17:01.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64416 req_id = a9404f93-f9c3-4ca7-8e5b-489f3ed8cf79 response_code = 204 uri = /eip-gateways
20402024-12-21T06:17:01.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61900
20412024-12-21T06:17:01.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61900 req_id = bf3f13ff-1548-49d4-a83d-208516d0cc5a response_code = 200 uri = /vpc-routes
20422024-12-21T06:17:01.872ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
20432024-12-21T06:17:01.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61900 req_id = 0497743f-2b4a-4690-8580-cfa40eb297c2 response_code = 204 uri = /eip-gateways
20442024-12-21T06:17:01.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56941
20452024-12-21T06:17:01.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56941 req_id = e57a9066-0564-44e3-91f4-7be36a3b7611 response_code = 200 uri = /v2p
20462024-12-21T06:17:01.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61900 req_id = 07e3e118-a073-46b0-be39-246678b34cf5 response_code = 204 uri = /vpc-routes
20472024-12-21T06:17:01.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42453
20482024-12-21T06:17:01.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42453 req_id = 1bc26612-d1a9-4be8-8655-3a1e079ce5f9 response_code = 200 uri = /v2p
20492024-12-21T06:17:01.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64416 req_id = ba999a6a-4405-4b98-a1c4-5398cd1c4c08 response_code = 204 uri = /vpc-routes
20502024-12-21T06:17:01.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46151
20512024-12-21T06:17:01.968ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20522024-12-21T06:17:02.009ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20532024-12-21T06:17:02.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94377 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46151 req_id = 83b5e7af-ff7e-4879-b4f0-844503361512 response_code = 204 uri = /switch-ports
20542024-12-21T06:17:02.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46151 req_id = 61686c3d-3bae-4bb8-b1f5-23897337e1a6 response_code = 200 uri = /network-bootstore-config
20552024-12-21T06:17:02.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60361
20562024-12-21T06:17:02.271ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20572024-12-21T06:17:02.312ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20582024-12-21T06:17:02.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98370 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60361 req_id = 78d27482-ca10-45f4-b8fe-ccbcca5bc68c response_code = 204 uri = /switch-ports
20592024-12-21T06:17:02.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60361 req_id = 311a61da-2973-4a14-9efe-2b1b35dc5a8c response_code = 200 uri = /network-bootstore-config
20602024-12-21T06:17:13.987ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7919 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 7395a50c-0863-4959-90f1-32deb76021d4 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
20612024-12-21T06:17:22.368ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40545
20622024-12-21T06:17:22.368ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40545 req_id = 2234da95-5a41-4725-91f2-32fccc4b80a5 response_code = 200 uri = /baseboard
20632024-12-21T06:17:30.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48931
20642024-12-21T06:17:30.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48931 req_id = d5e1fa78-8ef7-4ad5-90e3-b58eee2d80f4 response_code = 200 uri = /vpc-routes
20652024-12-21T06:17:30.601ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
20662024-12-21T06:17:30.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48931 req_id = 1591acc4-d0d8-48eb-83a5-cbabdd8f5409 response_code = 204 uri = /eip-gateways
20672024-12-21T06:17:30.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57873
20682024-12-21T06:17:30.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57873 req_id = 85adacfd-60a0-4791-b030-a5d5cc41df7f response_code = 200 uri = /v2p
20692024-12-21T06:17:30.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63231
20702024-12-21T06:17:30.691ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20712024-12-21T06:17:30.729ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20722024-12-21T06:17:30.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63231 req_id = b488b0d9-645d-4b9c-89a3-4207158419b2 response_code = 204 uri = /switch-ports
20732024-12-21T06:17:30.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48931 req_id = 0fb46a65-f0a7-44a9-a244-1ce645e87bda response_code = 204 uri = /vpc-routes
20742024-12-21T06:17:30.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63231 req_id = 60383c2b-a3b6-4c4e-9dbd-faddd0c8fcd8 response_code = 200 uri = /network-bootstore-config
20752024-12-21T06:17:31.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57423
20762024-12-21T06:17:31.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57423 req_id = 028ee661-9dd2-45af-8a6e-f40e82e1e2d2 response_code = 200 uri = /vpc-routes
20772024-12-21T06:17:31.653ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
20782024-12-21T06:17:31.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57423 req_id = d8eca256-fe55-48b4-9b93-9c670b3d1720 response_code = 204 uri = /eip-gateways
20792024-12-21T06:17:31.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57423 req_id = cfc7fb86-52d5-437f-8acb-473376c4899f response_code = 204 uri = /vpc-routes
20802024-12-21T06:17:31.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35255
20812024-12-21T06:17:31.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35255 req_id = a4521d9d-0ac3-433c-8a21-97f9c0d54189 response_code = 200 uri = /vpc-routes
20822024-12-21T06:17:31.705ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
20832024-12-21T06:17:31.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35255 req_id = 7ae29b5f-8722-4aba-8665-9343c8719172 response_code = 204 uri = /eip-gateways
20842024-12-21T06:17:31.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47059
20852024-12-21T06:17:31.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47059 req_id = 6a6885b8-da88-4435-ad0d-cba0c9c887eb response_code = 200 uri = /v2p
20862024-12-21T06:17:31.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47777
20872024-12-21T06:17:31.763ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20882024-12-21T06:17:31.800ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20892024-12-21T06:17:31.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91688 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47777 req_id = 0b0fbc8b-bf25-4a33-ab78-b52d5939328a response_code = 204 uri = /switch-ports
20902024-12-21T06:17:31.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60526
20912024-12-21T06:17:31.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35255 req_id = f9bc8285-a12c-45e0-be2c-75399c80e060 response_code = 204 uri = /vpc-routes
20922024-12-21T06:17:31.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47777 req_id = 813eed4d-6312-42af-995b-312a85de8cb8 response_code = 200 uri = /network-bootstore-config
20932024-12-21T06:17:31.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60526 req_id = eb259291-8e6f-4a6d-8d93-1448bb91b708 response_code = 200 uri = /v2p
20942024-12-21T06:17:31.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48272
20952024-12-21T06:17:31.868ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20962024-12-21T06:17:31.900ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20972024-12-21T06:17:31.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88933 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48272 req_id = 5d3f593e-777e-47e1-a450-7b8ad4fcee88 response_code = 204 uri = /switch-ports
20982024-12-21T06:17:31.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48272 req_id = 4602bc8b-f371-4cfc-ac6b-2123607040ab response_code = 200 uri = /network-bootstore-config
20992024-12-21T06:17:43.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6933 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = dfa63a6e-e22a-46d8-b494-f1736825a352 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
21002024-12-21T06:17:52.402ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36038
21012024-12-21T06:17:52.402ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36038 req_id = b41c4c40-e604-4ee7-8a77-f3af99f68dde response_code = 200 uri = /baseboard
21022024-12-21T06:18:00.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58651
21032024-12-21T06:18:00.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58651 req_id = 6423662f-22e5-4321-be5e-beb41395e576 response_code = 200 uri = /vpc-routes
21042024-12-21T06:18:00.655ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
21052024-12-21T06:18:00.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58651 req_id = 9df511bd-eeb1-4fb4-b816-fcd048607e8d response_code = 204 uri = /eip-gateways
21062024-12-21T06:18:00.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60029
21072024-12-21T06:18:00.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60029 req_id = aafa2fb6-efb0-4ad7-b31a-3f5c810a9747 response_code = 200 uri = /v2p
21082024-12-21T06:18:00.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58651 req_id = 8e0bcf64-e17d-46dd-993e-dacd844f8d1f response_code = 204 uri = /vpc-routes
21092024-12-21T06:18:00.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63433
21102024-12-21T06:18:00.873ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21112024-12-21T06:18:00.909ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21122024-12-21T06:18:00.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91130 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63433 req_id = 61a4cad8-5ffc-4d5e-9284-99d125a99f55 response_code = 204 uri = /switch-ports
21132024-12-21T06:18:00.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63433 req_id = 39458cbf-a61c-4508-b954-fcaf2996e73e response_code = 200 uri = /network-bootstore-config
21142024-12-21T06:18:01.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49511
21152024-12-21T06:18:01.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49511 req_id = e23d3593-20bb-492a-8dda-90458d362f99 response_code = 200 uri = /vpc-routes
21162024-12-21T06:18:01.747ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59124
21172024-12-21T06:18:01.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59124 req_id = ab8d899d-45a7-43cf-b087-85d28d2ebaa0 response_code = 200 uri = /v2p
21182024-12-21T06:18:01.790ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
21192024-12-21T06:18:01.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49511 req_id = 64f1e459-dcbc-4516-8d59-0f02c8e63afe response_code = 204 uri = /eip-gateways
21202024-12-21T06:18:01.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49511 req_id = 10079789-9aa3-40e9-8430-4ce0ce1fd72e response_code = 204 uri = /vpc-routes
21212024-12-21T06:18:01.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35687
21222024-12-21T06:18:01.814ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21232024-12-21T06:18:01.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21242024-12-21T06:18:01.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105960 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35687 req_id = 7323ecd6-e488-49e8-8859-ee22713fd742 response_code = 204 uri = /switch-ports
21252024-12-21T06:18:01.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49164
21262024-12-21T06:18:01.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49164 req_id = 573ce208-3a1d-4f89-ab38-f496640534f4 response_code = 200 uri = /vpc-routes
21272024-12-21T06:18:01.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35687 req_id = 63905c16-ebd4-415c-a692-28e5342d9989 response_code = 200 uri = /network-bootstore-config
21282024-12-21T06:18:01.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37258
21292024-12-21T06:18:01.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37258 req_id = bb7432fd-f66c-46a0-b165-29a698914bf6 response_code = 200 uri = /v2p
21302024-12-21T06:18:01.962ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
21312024-12-21T06:18:01.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49164 req_id = d03a7bb6-b193-43fa-a99b-9a7f8481e824 response_code = 204 uri = /eip-gateways
21322024-12-21T06:18:01.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49164 req_id = 6f934154-feb5-4304-b811-a6d8eaac6068 response_code = 204 uri = /vpc-routes
21332024-12-21T06:18:02.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54030
21342024-12-21T06:18:02.017ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21352024-12-21T06:18:02.056ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21362024-12-21T06:18:02.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91583 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54030 req_id = c162c9af-6f96-4c2c-abc5-5639d5ff7f90 response_code = 204 uri = /switch-ports
21372024-12-21T06:18:02.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54030 req_id = c75299ea-0556-468f-bb57-0e74a70df920 response_code = 200 uri = /network-bootstore-config
21382024-12-21T06:18:13.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7867 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 268db486-2b5a-45d8-a1e3-b8635622e5f5 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
21392024-12-21T06:18:22.435ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50293
21402024-12-21T06:18:22.435ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50293 req_id = 5c4de144-6fcf-4e52-945d-cd160d033ced response_code = 200 uri = /baseboard
21412024-12-21T06:18:30.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61779
21422024-12-21T06:18:30.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61779 req_id = b7140442-99b3-4894-bd3e-c4a04ad4da98 response_code = 200 uri = /vpc-routes
21432024-12-21T06:18:30.557ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
21442024-12-21T06:18:30.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61779 req_id = a0683030-5851-43ed-95ef-202548dda940 response_code = 204 uri = /eip-gateways
21452024-12-21T06:18:30.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61779 req_id = 30b7720b-49cb-48fa-aff6-7f2b63707b03 response_code = 204 uri = /vpc-routes
21462024-12-21T06:18:30.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49350
21472024-12-21T06:18:30.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49350 req_id = c8d24914-b3fb-4316-9072-5ac1c760e2a5 response_code = 200 uri = /v2p
21482024-12-21T06:18:30.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54137
21492024-12-21T06:18:30.638ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21502024-12-21T06:18:30.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21512024-12-21T06:18:30.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54137 req_id = 42efc9fb-608f-4f33-bb45-e6aabd406fef response_code = 204 uri = /switch-ports
21522024-12-21T06:18:30.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54137 req_id = d4814bcb-91f5-4e19-aef7-6b1b00a02ecd response_code = 200 uri = /network-bootstore-config
21532024-12-21T06:18:31.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32936
21542024-12-21T06:18:31.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32936 req_id = 9221bc6a-dcf5-4e2e-a5ad-d879b3c2841c response_code = 200 uri = /vpc-routes
21552024-12-21T06:18:31.655ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
21562024-12-21T06:18:31.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32936 req_id = a964f88a-fed8-46df-9c3e-bb5d103fcc6c response_code = 204 uri = /eip-gateways
21572024-12-21T06:18:31.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32936 req_id = 90f83184-389e-4a00-a0d4-30dd4b872027 response_code = 204 uri = /vpc-routes
21582024-12-21T06:18:31.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40356
21592024-12-21T06:18:31.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40356 req_id = 536f7359-f4c3-44e7-8fc3-d3cb79f149a4 response_code = 200 uri = /vpc-routes
21602024-12-21T06:18:31.725ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
21612024-12-21T06:18:31.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40356 req_id = c63f03ba-a6f8-455a-ae63-f757871363ad response_code = 204 uri = /eip-gateways
21622024-12-21T06:18:31.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40356 req_id = 82671772-18f8-403d-a5aa-e5ec5f102037 response_code = 204 uri = /vpc-routes
21632024-12-21T06:18:31.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53570
21642024-12-21T06:18:31.790ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21652024-12-21T06:18:31.826ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21662024-12-21T06:18:31.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88588 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53570 req_id = b50247d8-eeae-4085-b498-442bedc41afd response_code = 204 uri = /switch-ports
21672024-12-21T06:18:31.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35039
21682024-12-21T06:18:31.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35039 req_id = 898d8bac-d902-45d6-9687-d4e2b1e78b1d response_code = 200 uri = /v2p
21692024-12-21T06:18:31.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53570 req_id = 27bff381-652d-4f8c-8213-9872eac9edff response_code = 200 uri = /network-bootstore-config
21702024-12-21T06:18:31.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38492
21712024-12-21T06:18:31.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38492 req_id = b4c600fb-b6c9-46d2-9a37-684816823855 response_code = 200 uri = /v2p
21722024-12-21T06:18:31.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51806
21732024-12-21T06:18:31.962ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21742024-12-21T06:18:31.999ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21752024-12-21T06:18:32.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94407 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51806 req_id = fda64831-7c23-4319-82ad-29277432c8a1 response_code = 204 uri = /switch-ports
21762024-12-21T06:18:32.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51806 req_id = ea9133c3-5a95-481e-895e-8421def43699 response_code = 200 uri = /network-bootstore-config
21772024-12-21T06:18:43.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7369 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = d07f20d7-c9fd-4c6f-a855-d8ced9db08ab response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
21782024-12-21T06:18:52.468ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37739
21792024-12-21T06:18:52.468ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37739 req_id = a2803e9f-f414-4faa-b5dd-b0b1c6aba20f response_code = 200 uri = /baseboard
21802024-12-21T06:19:00.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33988
21812024-12-21T06:19:00.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33988 req_id = bf90226f-6900-4525-9ae0-b633409ce6c4 response_code = 200 uri = /vpc-routes
21822024-12-21T06:19:00.722ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
21832024-12-21T06:19:00.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33988 req_id = c9578338-e5a1-4ecd-85dd-23eb19c25ed9 response_code = 204 uri = /eip-gateways
21842024-12-21T06:19:00.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33988 req_id = 87710bbd-477d-468a-961d-d1f79f86e25c response_code = 204 uri = /vpc-routes
21852024-12-21T06:19:00.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43444
21862024-12-21T06:19:00.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43444 req_id = ff5f342b-0588-4816-9f4e-af57bcd1a221 response_code = 200 uri = /v2p
21872024-12-21T06:19:00.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48845
21882024-12-21T06:19:00.930ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21892024-12-21T06:19:00.931ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21902024-12-21T06:19:00.931ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21912024-12-21T06:19:00.931ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21922024-12-21T06:19:00.931ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21932024-12-21T06:19:00.931ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21942024-12-21T06:19:00.931ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21952024-12-21T06:19:00.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48845 req_id = 7918ed99-b26a-456c-8d8f-c0d24ff77741 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21962024-12-21T06:19:00.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54005
21972024-12-21T06:19:00.952ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21982024-12-21T06:19:00.989ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21992024-12-21T06:19:01.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54005 req_id = b5255e00-86cb-49f5-8fe7-8c92044b32f4 response_code = 204 uri = /switch-ports
22002024-12-21T06:19:01.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54005 req_id = 432515d6-2049-4a1a-9074-df6c2330b1f2 response_code = 200 uri = /network-bootstore-config
22012024-12-21T06:19:01.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33479
22022024-12-21T06:19:01.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33479 req_id = 511bd4ee-122a-480d-8fe0-7004ca64b7e0 response_code = 200 uri = /vpc-routes
22032024-12-21T06:19:01.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
22042024-12-21T06:19:01.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33479 req_id = 4e9e7873-4de2-4a81-82ba-aba656e54d15 response_code = 204 uri = /eip-gateways
22052024-12-21T06:19:01.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48623
22062024-12-21T06:19:01.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48623 req_id = 954b29d0-9afc-42d4-9fd3-3bd8be063894 response_code = 200 uri = /v2p
22072024-12-21T06:19:01.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33479 req_id = 078de4a6-257a-4af4-b12a-811a6436407b response_code = 204 uri = /vpc-routes
22082024-12-21T06:19:01.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40383
22092024-12-21T06:19:01.897ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22102024-12-21T06:19:01.897ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22112024-12-21T06:19:01.897ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22122024-12-21T06:19:01.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22132024-12-21T06:19:01.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22142024-12-21T06:19:01.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22152024-12-21T06:19:01.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22162024-12-21T06:19:01.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 385 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40383 req_id = 5c9d6294-1428-4521-a177-56023fe92ac9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22172024-12-21T06:19:01.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43415
22182024-12-21T06:19:01.912ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22192024-12-21T06:19:01.948ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22202024-12-21T06:19:02.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95033 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43415 req_id = 5878fba9-cfef-4035-8ff0-e69af521f328 response_code = 204 uri = /switch-ports
22212024-12-21T06:19:02.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48129
22222024-12-21T06:19:02.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48129 req_id = e7f6bc03-436e-499a-8938-da45cdc20d36 response_code = 200 uri = /vpc-routes
22232024-12-21T06:19:02.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43415 req_id = 16147e92-580e-417c-a0f2-17e449696dd2 response_code = 200 uri = /network-bootstore-config
22242024-12-21T06:19:02.051ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
22252024-12-21T06:19:02.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48129 req_id = e2a1c2d3-82ae-4b98-be10-9251186f1e0d response_code = 204 uri = /eip-gateways
22262024-12-21T06:19:02.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48129 req_id = 2ead08a7-8f38-46eb-bcc7-0a7fcc4d7519 response_code = 204 uri = /vpc-routes
22272024-12-21T06:19:02.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37780
22282024-12-21T06:19:02.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37780 req_id = f42ad22e-f887-431f-84bb-3105af4bff05 response_code = 200 uri = /v2p
22292024-12-21T06:19:02.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58362
22302024-12-21T06:19:02.161ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22312024-12-21T06:19:02.201ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22322024-12-21T06:19:02.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94371 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58362 req_id = fe7c8f58-52c6-49c2-bd85-bf2e2f0fd85a response_code = 204 uri = /switch-ports
22332024-12-21T06:19:02.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58362 req_id = 114304ee-5811-47f3-bfd9-04b347000702 response_code = 200 uri = /network-bootstore-config
22342024-12-21T06:19:02.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63439
22352024-12-21T06:19:02.322ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22362024-12-21T06:19:02.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22372024-12-21T06:19:02.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22382024-12-21T06:19:02.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22392024-12-21T06:19:02.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22402024-12-21T06:19:02.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22412024-12-21T06:19:02.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22422024-12-21T06:19:02.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63439 req_id = 1ad45c4a-5e5a-4a02-aa6d-ae7686e04b72 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22432024-12-21T06:19:13.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7340 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 9cb50643-9943-4d99-a543-eaa44efc615d response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
22442024-12-21T06:19:22.502ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59419
22452024-12-21T06:19:22.502ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59419 req_id = 61060ec7-5f1e-4334-8ff7-e9ca80f93fd4 response_code = 200 uri = /baseboard
22462024-12-21T06:19:30.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36149
22472024-12-21T06:19:30.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36149 req_id = b161f75c-b72a-4eea-b1e2-39c99189d256 response_code = 200 uri = /vpc-routes
22482024-12-21T06:19:30.595ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
22492024-12-21T06:19:30.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36149 req_id = 2b12f039-b480-490c-a662-24c8948f27ca response_code = 204 uri = /eip-gateways
22502024-12-21T06:19:30.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36149 req_id = 0d6dc50b-fbee-4907-9c9a-c5a84ff1fb78 response_code = 204 uri = /vpc-routes
22512024-12-21T06:19:30.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60800
22522024-12-21T06:19:30.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60800 req_id = a71fb706-f9f9-4dff-9434-e225ef2c3987 response_code = 200 uri = /v2p
22532024-12-21T06:19:30.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46280
22542024-12-21T06:19:30.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22552024-12-21T06:19:30.776ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22562024-12-21T06:19:30.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90495 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46280 req_id = 90efe215-7c79-4e07-927b-b21b63845ff1 response_code = 204 uri = /switch-ports
22572024-12-21T06:19:30.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46280 req_id = 6d45d22c-d074-48ba-b12b-060a5f8fe157 response_code = 200 uri = /network-bootstore-config
22582024-12-21T06:19:31.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49623
22592024-12-21T06:19:31.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49623 req_id = ae718297-3cef-47e4-94ea-e34a48eb431a response_code = 200 uri = /vpc-routes
22602024-12-21T06:19:31.605ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
22612024-12-21T06:19:31.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49623 req_id = 101c7732-212e-44c4-89c5-558c90359c7e response_code = 204 uri = /eip-gateways
22622024-12-21T06:19:31.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49623 req_id = 7e99223f-58cb-4b30-8a18-755a90650bc9 response_code = 204 uri = /vpc-routes
22632024-12-21T06:19:31.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52217
22642024-12-21T06:19:31.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52217 req_id = 0d3c7955-f2f9-4778-92d5-7229b79945a0 response_code = 200 uri = /v2p
22652024-12-21T06:19:31.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42897
22662024-12-21T06:19:31.649ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22672024-12-21T06:19:31.689ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22682024-12-21T06:19:31.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97146 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42897 req_id = cbb54dfd-6799-4ce5-a55c-4455a3ff38e8 response_code = 204 uri = /switch-ports
22692024-12-21T06:19:31.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42897 req_id = 04d13c43-03a0-49b6-834e-6395a57adaa3 response_code = 200 uri = /network-bootstore-config
22702024-12-21T06:19:31.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58197
22712024-12-21T06:19:31.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58197 req_id = 79599585-c7eb-45cf-9e42-e2999b405a02 response_code = 200 uri = /vpc-routes
22722024-12-21T06:19:31.789ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
22732024-12-21T06:19:31.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58197 req_id = 6733e51c-be25-4f44-9a05-c8c13a181692 response_code = 204 uri = /eip-gateways
22742024-12-21T06:19:31.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59905
22752024-12-21T06:19:31.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59905 req_id = a7de0923-edd9-497b-96c2-b96451470fb2 response_code = 200 uri = /v2p
22762024-12-21T06:19:31.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58197 req_id = 13eb8641-b50f-4496-9612-55de3bf93a97 response_code = 204 uri = /vpc-routes
22772024-12-21T06:19:31.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56996
22782024-12-21T06:19:31.855ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22792024-12-21T06:19:31.893ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22802024-12-21T06:19:31.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91574 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56996 req_id = 201c1534-3dad-41ba-89d3-c6b6de924678 response_code = 204 uri = /switch-ports
22812024-12-21T06:19:31.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56996 req_id = 34406999-de0b-493e-85db-2c5baff42c22 response_code = 200 uri = /network-bootstore-config
22822024-12-21T06:19:43.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7682 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 9a991118-4b36-4666-b5f8-7381aa684054 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
22832024-12-21T06:19:52.535ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42509
22842024-12-21T06:19:52.535ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42509 req_id = eabc0454-c08d-450d-987d-b0fad7a7eb30 response_code = 200 uri = /baseboard
22852024-12-21T06:20:00.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51991
22862024-12-21T06:20:00.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51991 req_id = 907de9c3-8138-40a2-8c00-df490db350bc response_code = 200 uri = /vpc-routes
22872024-12-21T06:20:00.751ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
22882024-12-21T06:20:00.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51991 req_id = 320ee51c-6d22-4473-8cdf-048939ca4246 response_code = 204 uri = /eip-gateways
22892024-12-21T06:20:00.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47897
22902024-12-21T06:20:00.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47897 req_id = 697cb3ed-8f7d-4c02-a5f5-19d707765c94 response_code = 200 uri = /v2p
22912024-12-21T06:20:00.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51991 req_id = 9cd2638a-b8b7-4a33-b90b-37dfc1b92c7c response_code = 204 uri = /vpc-routes
22922024-12-21T06:20:00.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36307
22932024-12-21T06:20:00.966ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22942024-12-21T06:20:01.004ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22952024-12-21T06:20:01.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94475 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36307 req_id = 7496639e-14de-4d8d-b98b-054ba6f4cbb9 response_code = 204 uri = /switch-ports
22962024-12-21T06:20:01.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36307 req_id = 5741f0f1-1012-4ec0-a2d4-e18e374744ed response_code = 200 uri = /network-bootstore-config
22972024-12-21T06:20:01.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50808
22982024-12-21T06:20:01.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50808 req_id = b12a6b1b-9b79-4cf1-90c5-b6d2f21f319e response_code = 200 uri = /vpc-routes
22992024-12-21T06:20:01.715ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
23002024-12-21T06:20:01.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50808 req_id = 99e6c64f-7963-4344-89f2-7dfe448b16bf response_code = 204 uri = /eip-gateways
23012024-12-21T06:20:01.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50808 req_id = ae92db10-6948-4ee8-8841-e63b0efc2e97 response_code = 204 uri = /vpc-routes
23022024-12-21T06:20:01.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57358
23032024-12-21T06:20:01.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57358 req_id = 4dc6f949-50e7-44a8-a411-1d09fcbd5cea response_code = 200 uri = /vpc-routes
23042024-12-21T06:20:01.848ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
23052024-12-21T06:20:01.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57358 req_id = 1db77d28-3227-4c9c-9852-bb650e7659a8 response_code = 204 uri = /eip-gateways
23062024-12-21T06:20:01.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65446
23072024-12-21T06:20:01.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65446 req_id = a600b2c9-dce3-43b0-93d1-67ae54733075 response_code = 200 uri = /v2p
23082024-12-21T06:20:01.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57358 req_id = 21191a48-b6f8-4150-8cba-92918d6fd9bb response_code = 204 uri = /vpc-routes
23092024-12-21T06:20:01.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62440
23102024-12-21T06:20:01.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62440 req_id = ab1a91c4-ae48-430e-b675-b348c8329e53 response_code = 200 uri = /v2p
23112024-12-21T06:20:01.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57755
23122024-12-21T06:20:01.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23132024-12-21T06:20:01.960ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23142024-12-21T06:20:02.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92819 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57755 req_id = 5bf0139b-c8d9-4c04-a3b4-636fa69c4c10 response_code = 204 uri = /switch-ports
23152024-12-21T06:20:02.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42723
23162024-12-21T06:20:02.015ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23172024-12-21T06:20:02.050ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23182024-12-21T06:20:02.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42723 req_id = 0dd1dcb7-31ad-4fb8-be77-f6b57c18fcaf response_code = 204 uri = /switch-ports
23192024-12-21T06:20:02.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42723 req_id = 327feffd-a9d3-4ee5-847f-0234173f7dab response_code = 200 uri = /network-bootstore-config
23202024-12-21T06:20:02.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57755 req_id = 57c97f8d-4fa0-476c-84a9-b8688a1a7d05 response_code = 200 uri = /network-bootstore-config
23212024-12-21T06:20:13.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7743 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 47cdd553-c5ba-4540-986a-41df711661ab response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
23222024-12-21T06:20:22.568ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50570
23232024-12-21T06:20:22.568ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50570 req_id = 47b50a38-31b3-4b31-a5dc-aee16760a2a8 response_code = 200 uri = /baseboard
23242024-12-21T06:20:30.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41320
23252024-12-21T06:20:30.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41320 req_id = 29ce2a6f-9931-4a5b-966a-534d52a1e206 response_code = 200 uri = /vpc-routes
23262024-12-21T06:20:30.531ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
23272024-12-21T06:20:30.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41320 req_id = 0bae8dc2-fb9c-4701-88bb-0c54341b52bf response_code = 204 uri = /eip-gateways
23282024-12-21T06:20:30.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41320 req_id = 4c5de5d8-cd67-42fc-9d38-a6d7bc6ea338 response_code = 204 uri = /vpc-routes
23292024-12-21T06:20:30.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39717
23302024-12-21T06:20:30.652ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23312024-12-21T06:20:30.688ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23322024-12-21T06:20:30.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90076 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39717 req_id = c6eb7b82-8538-4ad7-99db-c28269401f5d response_code = 204 uri = /switch-ports
23332024-12-21T06:20:30.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53177
23342024-12-21T06:20:30.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53177 req_id = 36ca8f0f-4b44-4a55-a41c-16582f241c99 response_code = 200 uri = /v2p
23352024-12-21T06:20:30.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39717 req_id = da9b17b6-768b-4a64-bace-0c7916a27f22 response_code = 200 uri = /network-bootstore-config
23362024-12-21T06:20:31.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37850
23372024-12-21T06:20:31.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37850 req_id = 9fb483e9-02f1-4260-a502-ff1a48022420 response_code = 200 uri = /vpc-routes
23382024-12-21T06:20:31.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42717
23392024-12-21T06:20:31.616ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23402024-12-21T06:20:31.658ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23412024-12-21T06:20:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102812 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42717 req_id = 5aaafb4e-0965-4ccb-b992-31213257c9c8 response_code = 204 uri = /switch-ports
23422024-12-21T06:20:31.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34135
23432024-12-21T06:20:31.719ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
23442024-12-21T06:20:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37850 req_id = 61260cfc-487d-4376-850e-df1c1f4f3a76 response_code = 204 uri = /eip-gateways
23452024-12-21T06:20:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42717 req_id = 5501ae3e-7127-4a4a-b1dd-5b792c26a97b response_code = 200 uri = /network-bootstore-config
23462024-12-21T06:20:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34135 req_id = 826c64ca-e565-4a2c-8b5c-68c4d4cb5228 response_code = 200 uri = /v2p
23472024-12-21T06:20:31.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37850 req_id = 46a73822-4d04-483c-bed7-04ebfbaf00a3 response_code = 204 uri = /vpc-routes
23482024-12-21T06:20:31.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44744
23492024-12-21T06:20:31.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44744 req_id = d0bfe192-bf00-4694-9322-b2f36b241881 response_code = 200 uri = /vpc-routes
23502024-12-21T06:20:31.778ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
23512024-12-21T06:20:31.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44744 req_id = d21b50cc-ff13-4599-8f8c-6da30eaa311d response_code = 204 uri = /eip-gateways
23522024-12-21T06:20:31.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55357
23532024-12-21T06:20:31.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55357 req_id = c2eaa17c-824b-4964-a974-258470594ebe response_code = 200 uri = /v2p
23542024-12-21T06:20:31.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44744 req_id = a45295db-6b98-4048-805d-be8b9e5b281f response_code = 204 uri = /vpc-routes
23552024-12-21T06:20:31.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62781
23562024-12-21T06:20:31.921ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23572024-12-21T06:20:31.958ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23582024-12-21T06:20:32.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92468 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62781 req_id = 9f15f2a7-e953-4035-9bd2-55c8cafe16e7 response_code = 204 uri = /switch-ports
23592024-12-21T06:20:32.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62781 req_id = fbbc447b-7bf9-4b8f-9a92-3e3e2a881376 response_code = 200 uri = /network-bootstore-config
23602024-12-21T06:20:43.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7941 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 75303164-e5b7-4bd6-829a-9a657a85404a response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
23612024-12-21T06:20:52.600ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61377
23622024-12-21T06:20:52.600ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61377 req_id = 80dd8dac-2da4-4788-bfc3-b2b8a103ae3d response_code = 200 uri = /baseboard
23632024-12-21T06:21:00.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64651
23642024-12-21T06:21:00.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64651 req_id = 7fda8640-2947-4f31-95e7-7d15b893e3dc response_code = 200 uri = /vpc-routes
23652024-12-21T06:21:00.741ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
23662024-12-21T06:21:00.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64651 req_id = dfdc9bdb-1456-4ab0-8990-b79868e0c4e4 response_code = 204 uri = /eip-gateways
23672024-12-21T06:21:00.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64651 req_id = 9cee65d5-78c4-4d04-9e86-1c3e7fa937ef response_code = 204 uri = /vpc-routes
23682024-12-21T06:21:00.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35944
23692024-12-21T06:21:00.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35944 req_id = 0eb2b980-5e59-477b-8881-be6ef733ac3f response_code = 200 uri = /v2p
23702024-12-21T06:21:00.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55050
23712024-12-21T06:21:00.931ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23722024-12-21T06:21:00.972ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23732024-12-21T06:21:01.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98110 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55050 req_id = 0c8013c9-08ae-4ecc-95b6-441ad92aec4f response_code = 204 uri = /switch-ports
23742024-12-21T06:21:01.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55050 req_id = 2a8c556e-059d-47f9-8439-bd20d6728e29 response_code = 200 uri = /network-bootstore-config
23752024-12-21T06:21:01.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53875
23762024-12-21T06:21:01.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53875 req_id = 4da68ac7-a558-4af8-a2c6-fe504bbbd2c0 response_code = 200 uri = /vpc-routes
23772024-12-21T06:21:01.672ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
23782024-12-21T06:21:01.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53875 req_id = 6e7520ae-39ce-4e52-b734-44b5844436a6 response_code = 204 uri = /eip-gateways
23792024-12-21T06:21:01.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53875 req_id = 881ef6af-3265-48de-b3f8-e475444cbfd9 response_code = 204 uri = /vpc-routes
23802024-12-21T06:21:01.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52760
23812024-12-21T06:21:01.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52760 req_id = 8932a082-792b-4726-ab1e-3c8afa4c4dff response_code = 200 uri = /v2p
23822024-12-21T06:21:01.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56408
23832024-12-21T06:21:01.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56408 req_id = 48742eb5-83fa-45c0-9ce3-612cf261e434 response_code = 200 uri = /vpc-routes
23842024-12-21T06:21:01.860ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
23852024-12-21T06:21:01.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56408 req_id = e25279d2-a7cf-417e-a4d7-a40b2161c586 response_code = 204 uri = /eip-gateways
23862024-12-21T06:21:01.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40937
23872024-12-21T06:21:01.864ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23882024-12-21T06:21:01.900ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23892024-12-21T06:21:01.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90763 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40937 req_id = 645a35ee-b7d4-4278-9ae9-8ca3e8cbd367 response_code = 204 uri = /switch-ports
23902024-12-21T06:21:01.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45984
23912024-12-21T06:21:01.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40937 req_id = ef110468-1e12-4ddd-94d3-b4ace58b5997 response_code = 200 uri = /network-bootstore-config
23922024-12-21T06:21:01.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 495 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56408 req_id = 93f7e35d-def5-42ba-a229-c9a7281a7404 response_code = 204 uri = /vpc-routes
23932024-12-21T06:21:01.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45984 req_id = 1504ad34-1dc4-43b2-895c-00438f265bd9 response_code = 200 uri = /v2p
23942024-12-21T06:21:01.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39414
23952024-12-21T06:21:01.986ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23962024-12-21T06:21:02.023ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23972024-12-21T06:21:02.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92930 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39414 req_id = 53bc0ae4-7476-4771-b850-11ff0ee3ba1c response_code = 204 uri = /switch-ports
23982024-12-21T06:21:02.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39414 req_id = 4b490d7a-74fb-4302-b48a-0f87145208a5 response_code = 200 uri = /network-bootstore-config
23992024-12-21T06:21:13.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7058 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 83baa2c0-b0e5-44d4-8f66-4b465d73ec26 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
24002024-12-21T06:21:20.421ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24012024-12-21T06:21:20.422ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24022024-12-21T06:21:20.453ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2011, tv_nsec: 537732711 } time_to_next_cleanup = 599.99999793s
24032024-12-21T06:21:22.633ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46819
24042024-12-21T06:21:22.633ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46819 req_id = bc3ef662-cdc6-4e71-a376-c2618af7b18f response_code = 200 uri = /baseboard
24052024-12-21T06:21:30.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39287
24062024-12-21T06:21:30.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39287 req_id = 2a7a97e4-90c8-45b5-a632-6afd594bc13f response_code = 200 uri = /vpc-routes
24072024-12-21T06:21:30.712ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
24082024-12-21T06:21:30.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39287 req_id = a831aa8d-906e-4c68-8c3d-2405a2e9196b response_code = 204 uri = /eip-gateways
24092024-12-21T06:21:30.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39287 req_id = bf1ec7b5-bd18-40c6-8736-0001ba742b2a response_code = 204 uri = /vpc-routes
24102024-12-21T06:21:30.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33450
24112024-12-21T06:21:30.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33450 req_id = ba1d20ff-58b6-4176-9d46-43cdb7192096 response_code = 200 uri = /v2p
24122024-12-21T06:21:30.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55383
24132024-12-21T06:21:30.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24142024-12-21T06:21:30.849ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24152024-12-21T06:21:30.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92587 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55383 req_id = 55c3d1e0-1c1d-445a-b2a7-535e1948e3fc response_code = 204 uri = /switch-ports
24162024-12-21T06:21:30.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55383 req_id = 9bccd761-69d7-45e4-b029-da4535c72e37 response_code = 200 uri = /network-bootstore-config
24172024-12-21T06:21:31.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53800
24182024-12-21T06:21:31.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53800 req_id = 821a4a89-3431-49fb-bada-d26db3e782a3 response_code = 200 uri = /vpc-routes
24192024-12-21T06:21:31.483ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
24202024-12-21T06:21:31.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53800 req_id = 023c99f1-4c2c-4263-b8b9-6b5c4b940a03 response_code = 204 uri = /eip-gateways
24212024-12-21T06:21:31.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53800 req_id = deddaccc-5f31-45fa-9e1f-243bb9fe4ae5 response_code = 204 uri = /vpc-routes
24222024-12-21T06:21:31.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38386
24232024-12-21T06:21:31.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38386 req_id = 4e2c43c0-36dd-424d-b72f-b0a4c72811a1 response_code = 200 uri = /v2p
24242024-12-21T06:21:31.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56441
24252024-12-21T06:21:31.663ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24262024-12-21T06:21:31.701ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24272024-12-21T06:21:31.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56441 req_id = 17ec0be1-7a7b-46bc-a237-92cec6ff1936 response_code = 204 uri = /switch-ports
24282024-12-21T06:21:31.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43281
24292024-12-21T06:21:31.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43281 req_id = df9403ed-be74-405f-a438-f31365b8b6e8 response_code = 200 uri = /vpc-routes
24302024-12-21T06:21:31.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56441 req_id = df611b8d-029a-4575-a8c2-87de21294975 response_code = 200 uri = /network-bootstore-config
24312024-12-21T06:21:31.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58824
24322024-12-21T06:21:31.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58824 req_id = bf1ee09d-9a89-456f-bb82-e204eb4fc4f3 response_code = 200 uri = /v2p
24332024-12-21T06:21:31.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49951
24342024-12-21T06:21:31.775ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24352024-12-21T06:21:31.812ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24362024-12-21T06:21:31.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92231 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49951 req_id = fa760a06-e26f-404b-a2f9-d3a7d25ad9a5 response_code = 204 uri = /switch-ports
24372024-12-21T06:21:31.867ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
24382024-12-21T06:21:31.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43281 req_id = a3d77414-6719-4d77-a1cd-322101404f2d response_code = 204 uri = /eip-gateways
24392024-12-21T06:21:31.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49951 req_id = 7d37e838-060b-479f-93d7-2af872599d76 response_code = 200 uri = /network-bootstore-config
24402024-12-21T06:21:31.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43281 req_id = bac94f96-2fb1-41f7-8563-2404b10ebf37 response_code = 204 uri = /vpc-routes
24412024-12-21T06:21:34.704ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24422024-12-21T06:21:43.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7255 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 7570295e-4a40-4844-9058-5aea7a2c6537 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
24432024-12-21T06:21:52.668ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63664
24442024-12-21T06:21:52.668ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63664 req_id = 21cf2efa-3189-4325-9828-30735c368575 response_code = 200 uri = /baseboard
24452024-12-21T06:22:00.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39537
24462024-12-21T06:22:00.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39537 req_id = 5624a135-041a-40b5-88fd-32afdbb6fdd4 response_code = 200 uri = /vpc-routes
24472024-12-21T06:22:00.828ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
24482024-12-21T06:22:00.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39537 req_id = 4c1ee0b4-f2a2-4c76-b46a-1d1f73ff2754 response_code = 204 uri = /eip-gateways
24492024-12-21T06:22:00.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39537 req_id = 2582a624-b39e-4573-8a5d-176cf11f9e38 response_code = 204 uri = /vpc-routes
24502024-12-21T06:22:00.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60532
24512024-12-21T06:22:00.905ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24522024-12-21T06:22:00.944ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24532024-12-21T06:22:01.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60532 req_id = 610bf1d4-54df-4b8f-b96c-7578dc00af31 response_code = 204 uri = /switch-ports
24542024-12-21T06:22:01.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35929
24552024-12-21T06:22:01.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35929 req_id = 7dc7de02-b300-4af2-bd28-9cc532e6350c response_code = 200 uri = /v2p
24562024-12-21T06:22:01.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60532 req_id = ab5348fd-bd27-440e-a90c-9429943d0a8b response_code = 200 uri = /network-bootstore-config
24572024-12-21T06:22:01.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61840
24582024-12-21T06:22:01.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61840 req_id = 734da731-95eb-45f1-b79c-d1d8f3c29f35 response_code = 200 uri = /vpc-routes
24592024-12-21T06:22:01.632ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
24602024-12-21T06:22:01.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61840 req_id = c41a9d32-0d48-43c3-b6ee-581ad63dc409 response_code = 204 uri = /eip-gateways
24612024-12-21T06:22:01.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61840 req_id = 7c4c3895-e79a-4e68-88a9-72244bda9d3f response_code = 204 uri = /vpc-routes
24622024-12-21T06:22:01.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51596
24632024-12-21T06:22:01.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51596 req_id = 8150a49d-75a0-4512-86c2-551dfd622f62 response_code = 200 uri = /vpc-routes
24642024-12-21T06:22:01.762ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
24652024-12-21T06:22:01.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51596 req_id = 45c503fb-313a-42c5-8ebd-5d20b92c25a0 response_code = 204 uri = /eip-gateways
24662024-12-21T06:22:01.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51596 req_id = 5db5d327-2ab2-432f-a648-73754d2ad58b response_code = 204 uri = /vpc-routes
24672024-12-21T06:22:01.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38900
24682024-12-21T06:22:01.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38900 req_id = f8f0e4ee-0df9-4f5d-9fa2-a07508249f55 response_code = 200 uri = /v2p
24692024-12-21T06:22:01.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46981
24702024-12-21T06:22:01.887ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24712024-12-21T06:22:01.924ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24722024-12-21T06:22:01.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94919 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46981 req_id = a5d3585e-b176-4e6a-9a11-75d4badf80b4 response_code = 204 uri = /switch-ports
24732024-12-21T06:22:01.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46981 req_id = c1ee7d0f-c3bb-49e7-b155-266c80371246 response_code = 200 uri = /network-bootstore-config
24742024-12-21T06:22:02.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42338
24752024-12-21T06:22:02.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42338 req_id = 89fb2563-224b-49e0-afcb-d352534edc23 response_code = 200 uri = /v2p
24762024-12-21T06:22:02.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50207
24772024-12-21T06:22:02.143ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24782024-12-21T06:22:02.181ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24792024-12-21T06:22:02.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92142 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50207 req_id = 1810ec53-0710-483a-a55f-3afaa22f0b8f response_code = 204 uri = /switch-ports
24802024-12-21T06:22:02.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50207 req_id = 2db91c07-2be4-4557-8d4f-a14fef55ae89 response_code = 200 uri = /network-bootstore-config
24812024-12-21T06:22:13.985ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7211 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 29c81c18-936f-48b4-8958-46b53a8d96e7 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
24822024-12-21T06:22:22.700ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54351
24832024-12-21T06:22:22.701ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54351 req_id = 0831e676-c889-469b-8f23-79ff588f58a4 response_code = 200 uri = /baseboard
24842024-12-21T06:22:30.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49763
24852024-12-21T06:22:30.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49763 req_id = 788db585-5f80-42a6-8eee-ed71161ce56e response_code = 200 uri = /vpc-routes
24862024-12-21T06:22:30.621ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
24872024-12-21T06:22:30.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49763 req_id = b25ffb8e-636e-4962-8c70-9d701c5899aa response_code = 204 uri = /eip-gateways
24882024-12-21T06:22:30.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49763 req_id = 1389b717-bc84-4379-8838-673e81186040 response_code = 204 uri = /vpc-routes
24892024-12-21T06:22:30.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58810
24902024-12-21T06:22:30.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58810 req_id = a39c9f55-bc38-4178-b8d5-0f77f6c8601b response_code = 200 uri = /v2p
24912024-12-21T06:22:30.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64834
24922024-12-21T06:22:30.727ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24932024-12-21T06:22:30.762ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24942024-12-21T06:22:30.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88202 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64834 req_id = b1c398b4-b25d-43e8-a1e5-42486a034bc2 response_code = 204 uri = /switch-ports
24952024-12-21T06:22:30.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64834 req_id = 17741b46-33c1-4c68-b0c9-5292036959b3 response_code = 200 uri = /network-bootstore-config
24962024-12-21T06:22:31.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63432
24972024-12-21T06:22:31.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63432 req_id = f83a58d7-7d2e-4930-80b9-2f3d23e83f10 response_code = 200 uri = /vpc-routes
24982024-12-21T06:22:31.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65269
24992024-12-21T06:22:31.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65269 req_id = 0e67deac-eae2-4ab7-94a2-cc38d02b1635 response_code = 200 uri = /v2p
25002024-12-21T06:22:31.616ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
25012024-12-21T06:22:31.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63432 req_id = 4760e453-3f41-4ee9-8a7c-3896b76a35a7 response_code = 204 uri = /eip-gateways
25022024-12-21T06:22:31.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63432 req_id = 572d968e-ecfd-4663-8799-7db42f32d855 response_code = 204 uri = /vpc-routes
25032024-12-21T06:22:31.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44988
25042024-12-21T06:22:31.641ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25052024-12-21T06:22:31.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25062024-12-21T06:22:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77975 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44988 req_id = 0461e9f7-d910-43d3-afdc-49d8d05df380 response_code = 204 uri = /switch-ports
25072024-12-21T06:22:31.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35302
25082024-12-21T06:22:31.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35302 req_id = 61c82c31-257b-4a2a-9166-a01601ca3a32 response_code = 200 uri = /vpc-routes
25092024-12-21T06:22:31.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44988 req_id = 02854078-4fed-4dd8-95bc-30eaa1d46331 response_code = 200 uri = /network-bootstore-config
25102024-12-21T06:22:31.735ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
25112024-12-21T06:22:31.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35302 req_id = 5ce6ca3c-b99f-4d44-8912-bb07f10ab05d response_code = 204 uri = /eip-gateways
25122024-12-21T06:22:31.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35302 req_id = 7819636d-a95d-4078-ac24-a09290376eb0 response_code = 204 uri = /vpc-routes
25132024-12-21T06:22:31.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35491
25142024-12-21T06:22:31.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35491 req_id = 43218434-1bae-4b23-af2d-a41e3d0793a5 response_code = 200 uri = /v2p
25152024-12-21T06:22:31.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51642
25162024-12-21T06:22:31.803ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25172024-12-21T06:22:31.837ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25182024-12-21T06:22:31.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51642 req_id = 97935126-5db0-4723-bd97-dc47f49fbdb3 response_code = 204 uri = /switch-ports
25192024-12-21T06:22:31.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51642 req_id = aa263564-f662-495f-9a7d-203eea3ab7df response_code = 200 uri = /network-bootstore-config
25202024-12-21T06:22:43.985ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7357 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 5ccd4be6-3005-4564-9726-958070145c8f response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
25212024-12-21T06:22:52.733ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54925
25222024-12-21T06:22:52.733ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54925 req_id = 5df10a3e-a847-4201-9aad-60c7347e270a response_code = 200 uri = /baseboard
25232024-12-21T06:23:00.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61642
25242024-12-21T06:23:00.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61642 req_id = d8fde29c-31f6-4faf-a03c-085aa7d4b51f response_code = 200 uri = /vpc-routes
25252024-12-21T06:23:00.700ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
25262024-12-21T06:23:00.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61642 req_id = 3adc90fd-6587-4079-a5f4-91bb0dac6af7 response_code = 204 uri = /eip-gateways
25272024-12-21T06:23:00.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61642 req_id = 3a76d6b3-9699-41b0-9765-c9c623fccdc7 response_code = 204 uri = /vpc-routes
25282024-12-21T06:23:00.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58597
25292024-12-21T06:23:00.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58597 req_id = c4f4f69d-4504-4bf2-9da4-25cc667b9a55 response_code = 200 uri = /v2p
25302024-12-21T06:23:00.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42481
25312024-12-21T06:23:00.881ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25322024-12-21T06:23:00.917ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25332024-12-21T06:23:00.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42481 req_id = 47a5b966-5538-487b-9544-d14357ca98a8 response_code = 204 uri = /switch-ports
25342024-12-21T06:23:00.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42481 req_id = 14beba01-67ec-439a-a97e-cc170878c072 response_code = 200 uri = /network-bootstore-config
25352024-12-21T06:23:01.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51006
25362024-12-21T06:23:01.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51006 req_id = b47b0adc-7bc6-4bd0-8e07-72363db448f5 response_code = 200 uri = /vpc-routes
25372024-12-21T06:23:01.672ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
25382024-12-21T06:23:01.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51006 req_id = 3cc3ce45-9276-4e8f-ac4b-c1630e6c78be response_code = 204 uri = /eip-gateways
25392024-12-21T06:23:01.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51006 req_id = bd9ae210-fc3e-42cd-aa4b-3874fd5164a3 response_code = 204 uri = /vpc-routes
25402024-12-21T06:23:01.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43269
25412024-12-21T06:23:01.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43269 req_id = bb4b4a75-608f-4938-8a93-373b7c645230 response_code = 200 uri = /vpc-routes
25422024-12-21T06:23:01.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39244
25432024-12-21T06:23:01.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39244 req_id = 54eaf2c0-37a2-4172-b7d8-a81bb4be010f response_code = 200 uri = /v2p
25442024-12-21T06:23:01.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48550
25452024-12-21T06:23:01.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48550 req_id = e3c41f1b-c392-4aaa-88c6-57908588eb41 response_code = 200 uri = /v2p
25462024-12-21T06:23:01.894ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
25472024-12-21T06:23:01.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43269 req_id = 71b1f3c9-ef14-42fc-8a58-959c4201e43a response_code = 204 uri = /eip-gateways
25482024-12-21T06:23:01.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43269 req_id = 180277f5-38d4-4412-b1cf-44f2d80cf892 response_code = 204 uri = /vpc-routes
25492024-12-21T06:23:01.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36743
25502024-12-21T06:23:01.934ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25512024-12-21T06:23:01.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25522024-12-21T06:23:02.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92792 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36743 req_id = 260fb1a3-1a3f-4055-bac4-07b8d5f43952 response_code = 204 uri = /switch-ports
25532024-12-21T06:23:02.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35245
25542024-12-21T06:23:02.027ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25552024-12-21T06:23:02.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3605 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36743 req_id = 953e8a39-dbe7-405e-8ea5-4c0970ceec0b response_code = 200 uri = /network-bootstore-config
25562024-12-21T06:23:02.061ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25572024-12-21T06:23:02.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93312 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35245 req_id = d139bb94-7702-4fc2-9cbf-7f5bb046b327 response_code = 204 uri = /switch-ports
25582024-12-21T06:23:02.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35245 req_id = 0a46d664-e15c-4940-84f1-cbe84912ef60 response_code = 200 uri = /network-bootstore-config
25592024-12-21T06:23:13.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7858 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 5e79fa33-6e03-42e7-b668-714c31690bf7 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
25602024-12-21T06:23:22.766ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46982
25612024-12-21T06:23:22.766ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46982 req_id = d4eeb27c-655e-4893-9b48-57e8257611bb response_code = 200 uri = /baseboard
25622024-12-21T06:23:30.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61825
25632024-12-21T06:23:30.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61825 req_id = e97a8302-1f1a-45c7-b31d-9f58362d0415 response_code = 200 uri = /vpc-routes
25642024-12-21T06:23:30.708ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
25652024-12-21T06:23:30.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61825 req_id = 21c0b4c7-e5bb-491f-b0bc-fe3724c2fcfd response_code = 204 uri = /eip-gateways
25662024-12-21T06:23:30.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57744
25672024-12-21T06:23:30.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57744 req_id = a3bd167a-3605-4b50-a640-4ea71d82bd3c response_code = 200 uri = /v2p
25682024-12-21T06:23:30.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61825 req_id = f07e5d58-418c-4ef2-8178-b5df024f2111 response_code = 204 uri = /vpc-routes
25692024-12-21T06:23:30.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37835
25702024-12-21T06:23:30.728ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25712024-12-21T06:23:30.768ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25722024-12-21T06:23:30.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94749 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37835 req_id = ea879317-655d-450e-bbb7-b381b85857f7 response_code = 204 uri = /switch-ports
25732024-12-21T06:23:30.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37835 req_id = 4a79f9cb-b371-4bd7-9e54-9d15f5b080e5 response_code = 200 uri = /network-bootstore-config
25742024-12-21T06:23:31.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53822
25752024-12-21T06:23:31.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53822 req_id = 4569ca6b-e0a7-43fb-906a-0149c7ee396a response_code = 200 uri = /vpc-routes
25762024-12-21T06:23:31.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
25772024-12-21T06:23:31.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53822 req_id = ef813786-f43f-4d1d-87fc-265fed487907 response_code = 204 uri = /eip-gateways
25782024-12-21T06:23:31.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50099
25792024-12-21T06:23:31.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50099 req_id = 25e3bf92-9b4a-4722-ac9d-a1108258fe1e response_code = 200 uri = /vpc-routes
25802024-12-21T06:23:31.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45768
25812024-12-21T06:23:31.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45768 req_id = 0a84d1eb-651d-4e06-83dc-9b0b57b3f6d4 response_code = 200 uri = /v2p
25822024-12-21T06:23:31.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5444 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53822 req_id = 8142b225-a37c-4496-a724-8d7d65a87c87 response_code = 204 uri = /vpc-routes
25832024-12-21T06:23:31.747ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65092
25842024-12-21T06:23:31.747ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25852024-12-21T06:23:31.788ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25862024-12-21T06:23:31.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65092 req_id = f25a5b4d-e2e3-41c2-8028-4a6dffcfb8f1 response_code = 204 uri = /switch-ports
25872024-12-21T06:23:31.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49581
25882024-12-21T06:23:31.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34044
25892024-12-21T06:23:31.849ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
25902024-12-21T06:23:31.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50099 req_id = 4ed5762f-a750-4feb-b6ed-8d969af53f79 response_code = 204 uri = /eip-gateways
25912024-12-21T06:23:31.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65092 req_id = 62fc9bcf-bb77-4e9e-9c75-4041bd3eded0 response_code = 200 uri = /network-bootstore-config
25922024-12-21T06:23:31.849ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25932024-12-21T06:23:31.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49581 req_id = 93749a37-8a9d-415c-9633-4b640b458c6c response_code = 200 uri = /v2p
25942024-12-21T06:23:31.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50099 req_id = 94188206-703a-4a34-85a7-ad15abede1db response_code = 204 uri = /vpc-routes
25952024-12-21T06:23:31.883ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25962024-12-21T06:23:31.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86448 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34044 req_id = 75e0845b-3c9a-4f50-bfd3-15bc96730c8c response_code = 204 uri = /switch-ports
25972024-12-21T06:23:31.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34044 req_id = 4eccdcc4-1e1b-4213-959b-b32aac23a9a9 response_code = 200 uri = /network-bootstore-config
25982024-12-21T06:23:43.987ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7453 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 34b3d858-b65d-4521-836e-c78b37776a91 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
25992024-12-21T06:23:52.799ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36501
26002024-12-21T06:23:52.799ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36501 req_id = 10d1bd81-5d1b-4a47-b37e-9b5b3800e320 response_code = 200 uri = /baseboard
26012024-12-21T06:24:00.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33872
26022024-12-21T06:24:00.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33872 req_id = 526d4e8c-4d83-46b3-9e6d-8eb3ae92228b response_code = 200 uri = /vpc-routes
26032024-12-21T06:24:00.728ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
26042024-12-21T06:24:00.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33872 req_id = 7cad6ba3-6381-4a77-a63e-c799fec40709 response_code = 204 uri = /eip-gateways
26052024-12-21T06:24:00.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33872 req_id = f00db5c3-2117-46e3-b590-4ab330b97c78 response_code = 204 uri = /vpc-routes
26062024-12-21T06:24:00.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50986
26072024-12-21T06:24:00.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50986 req_id = 68817125-5512-4309-ac80-253a75d65a63 response_code = 200 uri = /v2p
26082024-12-21T06:24:01.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39954
26092024-12-21T06:24:01.038ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26102024-12-21T06:24:01.038ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26112024-12-21T06:24:01.038ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-zones.json file = common/src/ledger.rs:177
26122024-12-21T06:24:01.038ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-zones.json file = common/src/ledger.rs:177
26132024-12-21T06:24:01.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48351
26142024-12-21T06:24:01.044ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26152024-12-21T06:24:01.052ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26162024-12-21T06:24:01.052ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6
26172024-12-21T06:24:01.083ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26182024-12-21T06:24:01.083ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c50bda89-deae-4199-9adf-06dda470c3af
26192024-12-21T06:24:01.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26202024-12-21T06:24:01.109ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26212024-12-21T06:24:01.109ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_13ee308e-c433-469e-b9ea-1dbf54a60851
26222024-12-21T06:24:01.132ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26232024-12-21T06:24:01.133ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb
26242024-12-21T06:24:01.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107850 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48351 req_id = 9b6501e9-6779-4ea5-b5e9-ef67247fe9da response_code = 204 uri = /switch-ports
26252024-12-21T06:24:01.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48351 req_id = 0e14fc4f-da8d-4e8b-8c08-b919e2c9d192 response_code = 200 uri = /network-bootstore-config
26262024-12-21T06:24:01.156ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26272024-12-21T06:24:01.156ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c
26282024-12-21T06:24:01.179ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26292024-12-21T06:24:01.179ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0
26302024-12-21T06:24:01.199ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26312024-12-21T06:24:01.199ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24
26322024-12-21T06:24:01.220ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26332024-12-21T06:24:01.220ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a
26342024-12-21T06:24:01.242ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26352024-12-21T06:24:01.242ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_957b9893-852a-42fc-af5f-4cd146632a7e
26362024-12-21T06:24:01.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39954 req_id = 67acc65e-e06f-4d26-9baa-0a25ff5a79b7 response_code = 200 uri = /inventory
26372024-12-21T06:24:01.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60762
26382024-12-21T06:24:01.424ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26392024-12-21T06:24:01.424ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26402024-12-21T06:24:01.424ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26412024-12-21T06:24:01.424ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26422024-12-21T06:24:01.424ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26432024-12-21T06:24:01.424ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26442024-12-21T06:24:01.424ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26452024-12-21T06:24:01.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 474 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60762 req_id = c77e6ae2-a1c6-4d8a-8899-60714974e386 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26462024-12-21T06:24:01.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42208
26472024-12-21T06:24:01.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42208 req_id = 0eebda31-7585-40d9-8d6e-08989b5438cd response_code = 200 uri = /vpc-routes
26482024-12-21T06:24:01.824ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
26492024-12-21T06:24:01.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42208 req_id = 96cf0fdd-1d50-45bf-a11d-e6698d649a5a response_code = 204 uri = /eip-gateways
26502024-12-21T06:24:01.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42208 req_id = 44d42144-b47e-4342-957b-ec19f0cbc117 response_code = 204 uri = /vpc-routes
26512024-12-21T06:24:01.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55987
26522024-12-21T06:24:01.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55987 req_id = 948baf4d-88cf-40ba-a576-873fab9e7468 response_code = 200 uri = /vpc-routes
26532024-12-21T06:24:01.890ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
26542024-12-21T06:24:01.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55987 req_id = 35bcd2c7-b751-4310-9560-a7f3ebc377e3 response_code = 204 uri = /eip-gateways
26552024-12-21T06:24:01.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48522
26562024-12-21T06:24:01.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26572024-12-21T06:24:01.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26582024-12-21T06:24:01.913ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-zones.json file = common/src/ledger.rs:177
26592024-12-21T06:24:01.913ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-zones.json file = common/src/ledger.rs:177
26602024-12-21T06:24:01.926ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26612024-12-21T06:24:01.926ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6
26622024-12-21T06:24:01.952ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26632024-12-21T06:24:01.952ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c50bda89-deae-4199-9adf-06dda470c3af
26642024-12-21T06:24:01.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42908
26652024-12-21T06:24:01.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42908 req_id = 053103d6-c011-41fc-9689-cd53a08bedb0 response_code = 200 uri = /v2p
26662024-12-21T06:24:01.975ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26672024-12-21T06:24:01.975ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_13ee308e-c433-469e-b9ea-1dbf54a60851
26682024-12-21T06:24:01.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 420 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55987 req_id = 4cd1bfc1-51ae-4de5-8f67-73233bf94900 response_code = 204 uri = /vpc-routes
26692024-12-21T06:24:01.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53123
26702024-12-21T06:24:01.988ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26712024-12-21T06:24:02.006ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26722024-12-21T06:24:02.007ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb
26732024-12-21T06:24:02.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50207
26742024-12-21T06:24:02.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50207 req_id = fc430c15-fae4-41a0-b527-16381f7bc8c8 response_code = 200 uri = /v2p
26752024-12-21T06:24:02.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26762024-12-21T06:24:02.033ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26772024-12-21T06:24:02.034ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c
26782024-12-21T06:24:02.060ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26792024-12-21T06:24:02.060ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0
26802024-12-21T06:24:02.087ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26812024-12-21T06:24:02.087ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24
26822024-12-21T06:24:02.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106755 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53123 req_id = 06473aad-1665-47cc-8310-9ae859a8fa7d response_code = 204 uri = /switch-ports
26832024-12-21T06:24:02.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53123 req_id = 924858d3-c197-4cbc-b833-b177a025a8f4 response_code = 200 uri = /network-bootstore-config
26842024-12-21T06:24:02.110ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26852024-12-21T06:24:02.110ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a
26862024-12-21T06:24:02.134ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26872024-12-21T06:24:02.134ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_957b9893-852a-42fc-af5f-4cd146632a7e
26882024-12-21T06:24:02.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48522 req_id = 07274657-dbf1-42c8-b583-ac53cfdbec8d response_code = 200 uri = /inventory
26892024-12-21T06:24:02.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59727
26902024-12-21T06:24:02.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26912024-12-21T06:24:02.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26922024-12-21T06:24:02.162ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/config/omicron-zones.json file = common/src/ledger.rs:177
26932024-12-21T06:24:02.163ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/config/omicron-zones.json file = common/src/ledger.rs:177
26942024-12-21T06:24:02.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44553
26952024-12-21T06:24:02.168ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26962024-12-21T06:24:02.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26972024-12-21T06:24:02.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26982024-12-21T06:24:02.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26992024-12-21T06:24:02.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27002024-12-21T06:24:02.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27012024-12-21T06:24:02.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27022024-12-21T06:24:02.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 710 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44553 req_id = d140b380-526a-460a-9520-543fd9380ef4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27032024-12-21T06:24:02.175ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27042024-12-21T06:24:02.175ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6
27052024-12-21T06:24:02.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37677
27062024-12-21T06:24:02.179ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27072024-12-21T06:24:02.203ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c50bda89-deae-4199-9adf-06dda470c3af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27082024-12-21T06:24:02.203ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c50bda89-deae-4199-9adf-06dda470c3af
27092024-12-21T06:24:02.219ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27102024-12-21T06:24:02.235ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 13ee308e-c433-469e-b9ea-1dbf54a60851 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27112024-12-21T06:24:02.235ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_13ee308e-c433-469e-b9ea-1dbf54a60851
27122024-12-21T06:24:02.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42251
27132024-12-21T06:24:02.244ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27142024-12-21T06:24:02.244ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27152024-12-21T06:24:02.244ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27162024-12-21T06:24:02.244ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27172024-12-21T06:24:02.244ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27182024-12-21T06:24:02.245ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27192024-12-21T06:24:02.245ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27202024-12-21T06:24:02.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 449 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42251 req_id = 0f1b2ec0-3989-4b46-b642-56e7bf83502d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27212024-12-21T06:24:02.262ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4c65c92f-403b-4154-a17e-6e529c57dfbb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27222024-12-21T06:24:02.262ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4c65c92f-403b-4154-a17e-6e529c57dfbb
27232024-12-21T06:24:02.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104867 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37677 req_id = faa6a92a-baa8-44ad-9d34-2991ea902076 response_code = 204 uri = /switch-ports
27242024-12-21T06:24:02.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37677 req_id = 5dda8854-0f02-4088-a4af-f13d9ee73450 response_code = 200 uri = /network-bootstore-config
27252024-12-21T06:24:02.288ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7249b8f2-2eaf-4ba7-b868-c638f0109e8c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27262024-12-21T06:24:02.288ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c
27272024-12-21T06:24:02.313ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 234eff41-ac4f-4fc4-9846-10ce5431a0b0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27282024-12-21T06:24:02.313ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_234eff41-ac4f-4fc4-9846-10ce5431a0b0
27292024-12-21T06:24:02.337ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ddb0f817-6f83-4c52-9219-0328f60b3f24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27302024-12-21T06:24:02.337ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ddb0f817-6f83-4c52-9219-0328f60b3f24
27312024-12-21T06:24:02.360ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ca8525c-d512-4829-b108-98cb3be6ac5a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27322024-12-21T06:24:02.360ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ca8525c-d512-4829-b108-98cb3be6ac5a
27332024-12-21T06:24:02.385ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 957b9893-852a-42fc-af5f-4cd146632a7e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27342024-12-21T06:24:02.385ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_957b9893-852a-42fc-af5f-4cd146632a7e
27352024-12-21T06:24:02.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59727 req_id = 16702e5d-d682-4d7a-a212-8cee493f8e6b response_code = 200 uri = /inventory
27362024-12-21T06:24:13.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8003 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = bfceffb5-ad0f-4493-98a8-fa36c1806aa1 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
27372024-12-21T06:24:22.832ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47544
27382024-12-21T06:24:22.832ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47544 req_id = 5fff4d49-5cd8-4b66-bd51-c0abbd224948 response_code = 200 uri = /baseboard
27392024-12-21T06:24:30.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51600
27402024-12-21T06:24:30.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51600 req_id = 9517d2fc-adcd-4136-ad06-e1888a0a2141 response_code = 200 uri = /vpc-routes
27412024-12-21T06:24:30.646ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
27422024-12-21T06:24:30.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51600 req_id = 141bb47e-5d5c-4731-81d3-99c693e3d962 response_code = 204 uri = /eip-gateways
27432024-12-21T06:24:30.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49117
27442024-12-21T06:24:30.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49117 req_id = 817d131f-42f7-4f62-a7ad-1d9faf48e9fa response_code = 200 uri = /v2p
27452024-12-21T06:24:30.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51600 req_id = eb3f48c2-6524-4758-9102-87cdc8ca6fa5 response_code = 204 uri = /vpc-routes
27462024-12-21T06:24:30.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32962
27472024-12-21T06:24:30.714ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27482024-12-21T06:24:30.754ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27492024-12-21T06:24:30.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97815 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32962 req_id = 12b115aa-9fc9-4dbc-ad65-e5597e8d8c71 response_code = 204 uri = /switch-ports
27502024-12-21T06:24:30.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32962 req_id = 2a16265e-a04c-4c41-a5f1-4694765c3358 response_code = 200 uri = /network-bootstore-config
27512024-12-21T06:24:31.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54649
27522024-12-21T06:24:31.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54649 req_id = 6535260d-e1d3-4ac4-8a41-0b9a34f1606e response_code = 200 uri = /vpc-routes
27532024-12-21T06:24:31.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51979
27542024-12-21T06:24:31.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51979 req_id = 417d0346-344e-4e11-8e6f-42d714c5af48 response_code = 200 uri = /vpc-routes
27552024-12-21T06:24:31.691ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
27562024-12-21T06:24:31.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54649 req_id = f188e9f8-f4d6-4796-8f38-00cdf5537212 response_code = 204 uri = /eip-gateways
27572024-12-21T06:24:31.705ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
27582024-12-21T06:24:31.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51979 req_id = 8c237d91-a074-41bb-a34f-7da019e8dc3b response_code = 204 uri = /eip-gateways
27592024-12-21T06:24:31.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51979 req_id = 878abf12-979e-4df2-a49e-58737b45dea0 response_code = 204 uri = /vpc-routes
27602024-12-21T06:24:31.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64550
27612024-12-21T06:24:31.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64550 req_id = 4409e637-6437-4991-9115-b130647e68cc response_code = 200 uri = /v2p
27622024-12-21T06:24:31.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54649 req_id = aacd9216-0d57-42f4-94ac-48563a73f6e2 response_code = 204 uri = /vpc-routes
27632024-12-21T06:24:31.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59981
27642024-12-21T06:24:31.753ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27652024-12-21T06:24:31.796ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27662024-12-21T06:24:31.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104897 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59981 req_id = 8e7f04e1-37b0-4c89-9c20-a5bd5f6e300a response_code = 204 uri = /switch-ports
27672024-12-21T06:24:31.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65409
27682024-12-21T06:24:31.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59981 req_id = 124ea381-742e-4154-908f-1656a011b4ed response_code = 200 uri = /network-bootstore-config
27692024-12-21T06:24:31.859ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27702024-12-21T06:24:31.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57094
27712024-12-21T06:24:31.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57094 req_id = 7c0db8b7-c05a-449f-89a6-935a3b0c0af4 response_code = 200 uri = /v2p
27722024-12-21T06:24:31.901ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27732024-12-21T06:24:31.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103265 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65409 req_id = 5dd95f29-cc31-40de-a70b-c229c35ca093 response_code = 204 uri = /switch-ports
27742024-12-21T06:24:31.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65409 req_id = 2137ab55-289a-41c0-84c6-a491c63c20b4 response_code = 200 uri = /network-bootstore-config
27752024-12-21T06:24:43.986ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7624 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = e761a150-c632-4abc-81d3-b2614b08f9b3 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
27762024-12-21T06:24:52.865ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58211
27772024-12-21T06:24:52.865ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58211 req_id = 9f62f039-5749-4f76-8134-a84f7ae6463b response_code = 200 uri = /baseboard
27782024-12-21T06:25:00.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43756
27792024-12-21T06:25:00.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43756 req_id = a1734890-8994-4b4a-9127-d95040c81b2e response_code = 200 uri = /v2p
27802024-12-21T06:25:00.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62240
27812024-12-21T06:25:00.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62240 req_id = e4e648fe-8424-4840-a67a-24e959c8ca70 response_code = 200 uri = /vpc-routes
27822024-12-21T06:25:00.920ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
27832024-12-21T06:25:00.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62240 req_id = 954e7698-6ae1-4744-b876-53df7c06c038 response_code = 204 uri = /eip-gateways
27842024-12-21T06:25:00.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62240 req_id = 54f14839-085b-49e9-8898-10c9bc197402 response_code = 204 uri = /vpc-routes
27852024-12-21T06:25:00.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47716
27862024-12-21T06:25:00.967ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27872024-12-21T06:25:01.003ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27882024-12-21T06:25:01.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47716 req_id = 52023aa4-2a90-48a4-b5c4-e99bd6dec19b response_code = 204 uri = /switch-ports
27892024-12-21T06:25:01.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47716 req_id = 1093766f-5bbd-43dd-87d2-761451a1c9ba response_code = 200 uri = /network-bootstore-config
27902024-12-21T06:25:01.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47143
27912024-12-21T06:25:01.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47143 req_id = daec6538-a9da-436a-9567-68cc5ba2e9bc response_code = 200 uri = /vpc-routes
27922024-12-21T06:25:01.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58795
27932024-12-21T06:25:01.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58795 req_id = e024d3df-e461-474d-987e-37eeb706489a response_code = 200 uri = /vpc-routes
27942024-12-21T06:25:01.795ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
27952024-12-21T06:25:01.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47143 req_id = 488a5340-a59d-4f01-a7d8-767501d34374 response_code = 204 uri = /eip-gateways
27962024-12-21T06:25:01.821ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
27972024-12-21T06:25:01.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58795 req_id = f3c4e256-3fa4-4f9a-b985-074ef4a3d03d response_code = 204 uri = /eip-gateways
27982024-12-21T06:25:01.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58795 req_id = 666296f1-1f99-46fb-b207-d4525497a2e4 response_code = 204 uri = /vpc-routes
27992024-12-21T06:25:01.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65281
28002024-12-21T06:25:01.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65281 req_id = d8aabfa4-1c67-4c10-86bf-2166b68aadf5 response_code = 200 uri = /v2p
28012024-12-21T06:25:01.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47143 req_id = 24f67664-d7e0-4afd-950f-660c48fa5758 response_code = 204 uri = /vpc-routes
28022024-12-21T06:25:01.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50015
28032024-12-21T06:25:01.982ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28042024-12-21T06:25:02.018ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28052024-12-21T06:25:02.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94306 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50015 req_id = 42f46d05-4663-4c3c-b8f2-b3b13e627da8 response_code = 204 uri = /switch-ports
28062024-12-21T06:25:02.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54849
28072024-12-21T06:25:02.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34985
28082024-12-21T06:25:02.077ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28092024-12-21T06:25:02.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3591 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54849 req_id = d67612d2-03ac-43b4-89e6-b3298605066a response_code = 200 uri = /v2p
28102024-12-21T06:25:02.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3676 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50015 req_id = bc7be737-f88e-40e0-9481-87a72fb7574e response_code = 200 uri = /network-bootstore-config
28112024-12-21T06:25:02.111ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28122024-12-21T06:25:02.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89488 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34985 req_id = 35b53db3-e9aa-4b0b-a792-4eb38a3a94ef response_code = 204 uri = /switch-ports
28132024-12-21T06:25:02.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34985 req_id = 2264284f-da64-408a-a0b2-bb08c3bc8b3a response_code = 200 uri = /network-bootstore-config
28142024-12-21T06:25:13.985ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7218 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = 58886efc-a203-40c7-8faa-434e9b3a6f98 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63
28152024-12-21T06:25:20.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33495
28162024-12-21T06:25:20.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33495 req_id = 4d30911a-5990-4b58-be5d-8425adc6c5a2 response_code = 200 uri = /v2p
28172024-12-21T06:25:20.352ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(16075393) }
28182024-12-21T06:25:20.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33495 req_id = f7e57be5-b63f-4f6c-9137-516a2959faa3 response_code = 204 uri = /v2p
28192024-12-21T06:25:20.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65392
28202024-12-21T06:25:20.455ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 85db9cae-f931-410f-a81e-eae6fe412747, kind: Instance { id: 38a50a35-0e56-40ad-b5d5-6490bf877b4e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16075393), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 85db9cae-f931-410f-a81e-eae6fe412747, kind: Instance { id: 38a50a35-0e56-40ad-b5d5-6490bf877b4e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16075393), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 85db9cae-f931-410f-a81e-eae6fe412747, kind: Instance { id: 38a50a35-0e56-40ad-b5d5-6490bf877b4e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16075393), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16075393))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 85db9cae-f931-410f-a81e-eae6fe412747, kind: Instance { id: 38a50a35-0e56-40ad-b5d5-6490bf877b4e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16075393), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 76d45e50-bb60-446d-8a55-4a9dc8e0750c, slot: 0, read_only: false, vcr_json: .., name: "disk-65662443d66" }], boot_settings: Some(InstanceBootSettings { order: [76d45e50-bb60-446d-8a55-4a9dc8e0750c] }), cloud_init_bytes: Some(..) } instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e metadata = InstanceMetadata { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, project_id: 9104b877-c20d-43a9-8254-1af8d4e761c2 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T06:25:20.450991099Z }
28212024-12-21T06:25:20.455ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e migration_id = None propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28222024-12-21T06:25:20.456ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e migration_id = None propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 85db9cae-f931-410f-a81e-eae6fe412747, kind: Instance { id: 38a50a35-0e56-40ad-b5d5-6490bf877b4e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16075393), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 85db9cae-f931-410f-a81e-eae6fe412747, kind: Instance { id: 38a50a35-0e56-40ad-b5d5-6490bf877b4e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16075393), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 85db9cae-f931-410f-a81e-eae6fe412747, kind: Instance { id: 38a50a35-0e56-40ad-b5d5-6490bf877b4e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16075393), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16075393))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 85db9cae-f931-410f-a81e-eae6fe412747, kind: Instance { id: 38a50a35-0e56-40ad-b5d5-6490bf877b4e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16075393), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 76d45e50-bb60-446d-8a55-4a9dc8e0750c, slot: 0, read_only: false, vcr_json: .., name: "disk-65662443d66" }], boot_settings: Some(InstanceBootSettings { order: [76d45e50-bb60-446d-8a55-4a9dc8e0750c] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T06:25:20.450991099Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28232024-12-21T06:25:20.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6508 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65392 req_id = ff8c12f5-d4e8-4a35-a21e-258360209423 response_code = 200 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
28242024-12-21T06:25:20.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64345
28252024-12-21T06:25:20.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64345 req_id = 1ec88f62-712f-43c9-a9c6-bd90dcb73b8b response_code = 200 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9/state
28262024-12-21T06:25:20.537ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 16075393 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28272024-12-21T06:25:20.537ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28282024-12-21T06:25:20.576ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9 file = illumos-utils/src/zone.rs:325 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28292024-12-21T06:25:20.600ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9 file = illumos-utils/src/zone.rs:363 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28302024-12-21T06:25:20.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45123
28312024-12-21T06:25:20.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45123 req_id = 055bc994-2918-405c-9dd8-d4829059fab4 response_code = 200 uri = /vpc-routes
28322024-12-21T06:25:20.720ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {85db9cae-f931-410f-a81e-eae6fe412747: {10.151.1.176: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}, 10.151.1.175: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}}} }
28332024-12-21T06:25:22.060ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28342024-12-21T06:25:22.060ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 zone = oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9
28352024-12-21T06:25:22.244ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 62.565434ms file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 zone = oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9
28362024-12-21T06:25:22.331ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 119.833739ms file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 zone = oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9
28372024-12-21T06:25:22.478ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 117.85722ms file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 zone = oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9
28382024-12-21T06:25:22.607ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 523.965511ms file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 zone = oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9
28392024-12-21T06:25:22.910ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35728
28402024-12-21T06:25:22.911ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35728 req_id = 1a280fdd-dfa2-48c4-85ec-99cee4f3f846 response_code = 200 uri = /baseboard
28412024-12-21T06:25:23.147ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 573.322045ms file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 zone = oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9
28422024-12-21T06:25:23.731ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 739.219832ms file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 zone = oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9
28432024-12-21T06:25:24.481ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 1.34612416s file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 zone = oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9
28442024-12-21T06:25:25.839ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 511.145205ms file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 zone = oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9
28452024-12-21T06:25:26.362ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 989.848494ms file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 zone = oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9
28462024-12-21T06:25:27.380ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9 file = sled-agent/src/instance.rs:2067 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28472024-12-21T06:25:27.390ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 64.308607ms file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28482024-12-21T06:25:27.465ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 108.232304ms file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28492024-12-21T06:25:27.585ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9") failed: Property not found. retry in 285.523962ms file = illumos-utils/src/svc.rs:36 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28502024-12-21T06:25:27.881ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28512024-12-21T06:25:27.920ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28522024-12-21T06:25:28.059ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28532024-12-21T06:25:28.060ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
28542024-12-21T06:25:28.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7340661 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45123 req_id = 8f21f4f1-21d2-4b15-aea1-be4a200b0c60 response_code = 204 uri = /eip-gateways
28552024-12-21T06:25:28.061ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-21T06:25:28.060749948Z } file = sled-agent/src/instance.rs:780 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28562024-12-21T06:25:28.061ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T06:25:28.060749948Z } propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28572024-12-21T06:25:28.061ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T06:25:28.060749948Z }, migration_in: None, migration_out: None }
28582024-12-21T06:25:28.120ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-21T06:25:28.120642439Z } file = sled-agent/src/instance.rs:780 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28592024-12-21T06:25:28.120ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T06:25:28.120642439Z } propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
28602024-12-21T06:25:28.120ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T06:25:28.120642439Z }, migration_in: None, migration_out: None }
28612024-12-21T06:25:28.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45123 req_id = 9583b883-1a67-4297-8006-78fbbcfa357e response_code = 204 uri = /vpc-routes
28622024-12-21T06:25:30.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49047
28632024-12-21T06:25:30.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1415 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49047 req_id = 765e172e-eaa6-4a30-a9b7-f08af00b326e response_code = 200 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9/state
28642024-12-21T06:25:30.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41269
28652024-12-21T06:25:30.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41269 req_id = ba7e7928-d6c6-457e-96c9-a94c301c39c2 response_code = 200 uri = /vpc-routes
28662024-12-21T06:25:30.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51568
28672024-12-21T06:25:30.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51568 req_id = b1bc83de-2cdd-4536-a3d7-32a5d9427c2e response_code = 200 uri = /v2p
28682024-12-21T06:25:30.646ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {85db9cae-f931-410f-a81e-eae6fe412747: {10.151.1.176: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}, 10.151.1.175: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}}} }
28692024-12-21T06:25:30.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41269 req_id = 8fea4915-43b7-4587-b9d3-45e28f1928fc response_code = 204 uri = /eip-gateways
28702024-12-21T06:25:30.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48540
28712024-12-21T06:25:30.660ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28722024-12-21T06:25:30.698ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28732024-12-21T06:25:30.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93021 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48540 req_id = e35be688-73c5-47f8-9b02-3e6873921f50 response_code = 204 uri = /switch-ports
28742024-12-21T06:25:30.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41269 req_id = c658f55f-66ec-4745-9c51-05e1b16697cf response_code = 204 uri = /vpc-routes
28752024-12-21T06:25:30.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48540 req_id = 50b7c7aa-e874-4d44-9a43-5b74d586e4c5 response_code = 200 uri = /network-bootstore-config
28762024-12-21T06:25:31.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42130
28772024-12-21T06:25:31.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42130 req_id = 96203a0e-21b5-435f-b872-9611217c75e3 response_code = 200 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9/state
28782024-12-21T06:25:31.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33820
28792024-12-21T06:25:31.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33820 req_id = ff24e3a2-9c59-473a-84ed-18af36805d6a response_code = 200 uri = /vpc-routes
28802024-12-21T06:25:31.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {85db9cae-f931-410f-a81e-eae6fe412747: {10.151.1.176: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}, 10.151.1.175: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}}} }
28812024-12-21T06:25:31.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33820 req_id = afce68e0-2354-448a-98d0-0d579330f07d response_code = 204 uri = /eip-gateways
28822024-12-21T06:25:31.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47729
28832024-12-21T06:25:31.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47729 req_id = 4442eb33-cc06-4150-943f-311afa67285a response_code = 200 uri = /vpc-routes
28842024-12-21T06:25:31.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47158
28852024-12-21T06:25:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47158 req_id = c5b92389-b995-447a-b461-3388554e93df response_code = 200 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9/state
28862024-12-21T06:25:31.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52722
28872024-12-21T06:25:31.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52722 req_id = de8ea4d4-1476-44ce-853d-1f1773dab8cd response_code = 200 uri = /v2p
28882024-12-21T06:25:31.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33820 req_id = 8da88b35-e827-44c1-8663-ba4de3eb2638 response_code = 204 uri = /vpc-routes
28892024-12-21T06:25:31.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52587
28902024-12-21T06:25:31.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28912024-12-21T06:25:31.786ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28922024-12-21T06:25:31.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97551 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52587 req_id = e3f24960-c2c5-4962-93a3-508729cc57a5 response_code = 204 uri = /switch-ports
28932024-12-21T06:25:31.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43016
28942024-12-21T06:25:31.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52587 req_id = 0e65130d-1126-4c20-aa1c-c2e8385f4437 response_code = 200 uri = /network-bootstore-config
28952024-12-21T06:25:31.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28962024-12-21T06:25:31.844ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {85db9cae-f931-410f-a81e-eae6fe412747: {10.151.1.176: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}, 10.151.1.175: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}}} }
28972024-12-21T06:25:31.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47729 req_id = 49e0e6eb-d99f-4c2f-a1d4-17560389940c response_code = 204 uri = /eip-gateways
28982024-12-21T06:25:31.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47729 req_id = e0609b03-cfa8-4848-978a-7948d63306fb response_code = 204 uri = /vpc-routes
28992024-12-21T06:25:31.884ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29002024-12-21T06:25:31.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60182
29012024-12-21T06:25:31.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60182 req_id = 53a67587-fa49-4ac6-85be-160fb937d208 response_code = 200 uri = /v2p
29022024-12-21T06:25:31.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98225 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43016 req_id = 48ba2344-7ff9-4ccf-b0fd-350b6e9a0730 response_code = 204 uri = /switch-ports
29032024-12-21T06:25:31.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43016 req_id = b6a1bf2a-a011-4703-932e-92b18a47b7f4 response_code = 200 uri = /network-bootstore-config
29042024-12-21T06:25:38.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47249
29052024-12-21T06:25:38.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 463 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47249 req_id = 4664bc5f-7352-4239-803b-faf224bc7bb4 response_code = 200 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9/state
29062024-12-21T06:25:38.215ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-21T06:25:38.215246613Z } file = sled-agent/src/instance.rs:780 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
29072024-12-21T06:25:38.215ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T06:25:38.215246613Z } propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
29082024-12-21T06:25:38.215ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T06:25:38.215246613Z }, migration_in: None, migration_out: None }
29092024-12-21T06:25:38.319ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-21T06:25:38.319096143Z } file = sled-agent/src/instance.rs:780 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
29102024-12-21T06:25:38.319ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-21T06:25:38.319096143Z } propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
29112024-12-21T06:25:38.319ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
29122024-12-21T06:25:38.319ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29132024-12-21T06:25:38.319ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 522130306291763327 n_samples = 6 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
29142024-12-21T06:25:38.319ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 6271912534277482716 n_samples = 6 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
29152024-12-21T06:25:38.319ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29162024-12-21T06:25:38.319ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/01f1b5f4-2545-4293-a417-f1e0bbf620d0/debug/bundle/zone", "/pool/int/2fc111fe-2b5c-4525-a70e-914c88174261/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/ebdd1b1f-ac6e-4f42-b5bc-06542e7938f6/crypt/debug", "/pool/ext/c50bda89-deae-4199-9adf-06dda470c3af/crypt/debug", "/pool/ext/13ee308e-c433-469e-b9ea-1dbf54a60851/crypt/debug", "/pool/ext/4c65c92f-403b-4154-a17e-6e529c57dfbb/crypt/debug", "/pool/ext/7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crypt/debug", "/pool/ext/234eff41-ac4f-4fc4-9846-10ce5431a0b0/crypt/debug", "/pool/ext/ddb0f817-6f83-4c52-9219-0328f60b3f24/crypt/debug", "/pool/ext/6ca8525c-d512-4829-b108-98cb3be6ac5a/crypt/debug", "/pool/ext/957b9893-852a-42fc-af5f-4cd146632a7e/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9
29172024-12-21T06:25:38.950ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9", bundle_id: 92724a59-3e44-406c-9e40-04baa15b85e2 }, time_created: 2024-12-21T06:25:38.320711758Z, version: 0, cause: TerminatedInstance }
29182024-12-21T06:25:38.950ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_d2013b0a-e7dc-4406-8397-663b3104e8b9 file = sled-agent/src/instance.rs:1313 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
29192024-12-21T06:25:40.725ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
29202024-12-21T06:25:40.743ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(16075393), kind: System }
29212024-12-21T06:25:40.743ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(16075393), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29222024-12-21T06:25:40.744ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T06:25:40.744246892Z }, migration_in: None, migration_out: None }
29232024-12-21T06:25:40.771ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T06:25:40.744246892Z }, migration_in: None, migration_out: None }
29242024-12-21T06:25:40.775ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
29252024-12-21T06:25:41.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45125
29262024-12-21T06:25:41.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45125 req_id = 6a8090b7-1c49-4653-b438-64d79a8c64c0 response_code = 200 uri = /vpc-routes
29272024-12-21T06:25:41.234ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {85db9cae-f931-410f-a81e-eae6fe412747: {10.151.1.176: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}, 10.151.1.175: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}}} }
29282024-12-21T06:25:41.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45125 req_id = d082e9cb-476f-48ca-acc6-1eecd23eb283 response_code = 204 uri = /eip-gateways
29292024-12-21T06:25:41.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45125 req_id = 8e6f679e-085a-4692-8ecc-34f88e5e493c response_code = 204 uri = /vpc-routes
29302024-12-21T06:25:41.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35406
29312024-12-21T06:25:41.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35406 req_id = d505e65e-333d-4379-a62b-23ff89de1a40 response_code = 200 uri = /v2p
29322024-12-21T06:25:41.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61433
29332024-12-21T06:25:41.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61433 req_id = 96b905ca-7511-455c-9a28-552875fa63c3 response_code = 200 uri = /v2p
29342024-12-21T06:25:41.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51405
29352024-12-21T06:25:41.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51405 req_id = 85176a42-db3b-4133-af9c-120d420f7270 response_code = 200 uri = /vpc-routes
29362024-12-21T06:25:41.713ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
29372024-12-21T06:25:41.713ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
29382024-12-21T06:25:41.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51405 req_id = 3bec2eb3-6d11-46e1-8307-6ee27adef7f8 response_code = 204 uri = /eip-gateways
29392024-12-21T06:25:41.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51405 req_id = 1f559deb-de2f-4acf-b38f-355cb6963511 response_code = 204 uri = /vpc-routes
29402024-12-21T06:25:42.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36910
29412024-12-21T06:25:42.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36910 req_id = 1876a46f-eef3-42e0-baf9-3a54f6560c2e response_code = 200 uri = /vpc-routes
29422024-12-21T06:25:42.544ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 values = ExternalIpGatewayMap { mappings: {} }
29432024-12-21T06:25:42.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36910 req_id = 01132c4c-88e9-4c35-9204-50f4e8160950 response_code = 204 uri = /eip-gateways
29442024-12-21T06:25:42.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36910 req_id = ef58bc87-1e14-4d8b-89df-14835c9e0406 response_code = 204 uri = /vpc-routes
29452024-12-21T06:25:43.985ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7467 local_addr = [fd00:1122:3344:101::1]:35662 method = GET remote_addr = [fd00:1122:3344:101::d]:39776 req_id = a265f144-3283-49f2-94b7-ab437af472a2 response_code = 200 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 uri = /cf7f8320-e45e-46f1-aa3b-b101ce937c63