Max level shown:
1 [ Aug 27 23:42:07 Enabled. ]
2 [ Aug 27 23:42:07 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Aug 27 23:42:07 Method "start" exited with status 0. ]
4 [ Aug 27 23:42:07 Rereading configuration. ]
5 [ Aug 27 23:42:07 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-08-27T23:42:07.166ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-08-27T23:42:07.166ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-08-27T23:42:07.219ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-08-27T23:42:07.219ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-08-27T23:42:07.335ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-08-27T23:42:07.344ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-08-27T23:42:07.352ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-08-27T23:42:07.955ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-08-27T23:42:08.093ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-08-27T23:42:08.093ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-08-27T23:42:08.093ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-08-27T23:42:08.093ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-08-27T23:42:08.093ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-08-27T23:42:08.093ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:716
212024-08-27T23:42:08.096ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:623
222024-08-27T23:42:08.096ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:765
232024-08-27T23:42:08.096ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-08-27T23:42:08.096ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:824
252024-08-27T23:42:08.096ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-08-27T23:42:08.096ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-08-27T23:42:08.096ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
282024-08-27T23:42:08.096ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-08-27T23:42:08.096ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-08-27T23:42:08.107ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:360
312024-08-27T23:42:08.107ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool)
322024-08-27T23:42:08.203ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool), kind: Internal }
332024-08-27T23:42:08.404ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:406
342024-08-27T23:42:08.404ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-08-27T23:42:08.404ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-08-27T23:42:08.404ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-08-27T23:42:08.404ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
382024-08-27T23:42:08.404ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-08-27T23:42:08.404ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-08-27T23:42:08.413ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:360
412024-08-27T23:42:08.413ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool)
422024-08-27T23:42:08.501ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool), kind: Internal }
432024-08-27T23:42:08.708ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-08-27T23:42:08.708ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-08-27T23:42:08.708ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
472024-08-27T23:42:08.708ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
482024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492024-08-27T23:42:08.708ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-08-27T23:42:08.708ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
512024-08-27T23:42:08.708ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
522024-08-27T23:42:08.708ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-08-27T23:42:08.708ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-08-27T23:42:08.708ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592024-08-27T23:42:08.708ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
602024-08-27T23:42:08.708ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-08-27T23:42:08.708ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-08-27T23:42:08.708ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
632024-08-27T23:42:08.708ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-08-27T23:42:08.708ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652024-08-27T23:42:08.708ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
662024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
672024-08-27T23:42:08.708ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
682024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
692024-08-27T23:42:08.708ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702024-08-27T23:42:08.708ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
712024-08-27T23:42:08.708ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
722024-08-27T23:42:08.708ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
732024-08-27T23:42:08.708ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
742024-08-27T23:42:08.708ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
752024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-08-27T23:42:08.708ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
782024-08-27T23:42:08.708ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
792024-08-27T23:42:08.708ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
802024-08-27T23:42:08.708ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
812024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-08-27T23:42:08.708ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
842024-08-27T23:42:08.708ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
852024-08-27T23:42:08.708ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
862024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
872024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
882024-08-27T23:42:08.708ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892024-08-27T23:42:08.708ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
902024-08-27T23:42:08.708ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
912024-08-27T23:42:08.708ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
922024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-08-27T23:42:08.708ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-08-27T23:42:08.708ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952024-08-27T23:42:08.709ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
962024-08-27T23:42:08.709ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972024-08-27T23:42:08.709ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
982024-08-27T23:42:08.709ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
992024-08-27T23:42:08.709ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1002024-08-27T23:42:08.709ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1012024-08-27T23:42:08.709ZINFOSledAgent (bootstore): No ledger in /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1022024-08-27T23:42:08.709ZINFOSledAgent (bootstore): No ledger in /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1032024-08-27T23:42:08.709ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1042024-08-27T23:42:08.709ZINFOSledAgent (bootstore): No ledger in /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-08-27T23:42:08.709ZINFOSledAgent (bootstore): No ledger in /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-08-27T23:42:08.709ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1072024-08-27T23:42:08.709ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1082024-08-27T23:42:08.709ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1092024-08-27T23:42:08.719ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:731
1102024-08-27T23:42:08.719ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1236, tv_nsec: 219306944 } time_to_next_cleanup = 599.999913429s
1112024-08-27T23:42:08.719ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3861
1122024-08-27T23:42:08.719ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1132024-08-27T23:42:08.719ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/sled-agent-request.json file = common/src/ledger.rs:188
1142024-08-27T23:42:08.719ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/sled-agent-request.json file = common/src/ledger.rs:188
1152024-08-27T23:42:08.722ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1162024-08-27T23:42:08.722ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1172024-08-27T23:42:08.722ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, local_pref: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1053
1182024-08-27T23:42:08.722ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
1192024-08-27T23:42:08.722ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1202024-08-27T23:42:08.722ZINFOSledAgent (RSS): No ledger in /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1212024-08-27T23:42:08.723ZINFOSledAgent (RSS): No ledger in /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1222024-08-27T23:42:08.723ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1113
1232024-08-27T23:42:08.723ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1242024-08-27T23:42:08.723ZINFOSledAgent (RSS): No ledger in /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/rss-sled-plan.json file = common/src/ledger.rs:188
1252024-08-27T23:42:08.723ZINFOSledAgent (RSS): No ledger in /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/rss-sled-plan.json file = common/src/ledger.rs:188
1262024-08-27T23:42:08.723ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1154
1272024-08-27T23:42:08.723ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:155
1282024-08-27T23:42:08.723ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:128
1292024-08-27T23:42:08.723ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1302024-08-27T23:42:08.723ZINFOSledAgent (RSS): Writing ledger to /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1312024-08-27T23:42:08.723ZINFOSledAgent (RSS): Writing ledger to /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1322024-08-27T23:42:08.723ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: b789fdaa-dfa9-4b88-b1cf-1807a37e31b9, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: b2ce5e72-9d59-4cfb-87ef-79f549e07564, rack_id: b789fdaa-dfa9-4b88-b1cf-1807a37e31b9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, local_pref: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:175
1332024-08-27T23:42:08.723ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1187
1342024-08-27T23:42:08.723ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1352024-08-27T23:42:08.723ZINFOSledAgent (bootstore): Writing ledger to /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1362024-08-27T23:42:08.723ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-08-27T23:42:08.724ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1382024-08-27T23:42:08.724ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: b2ce5e72-9d59-4cfb-87ef-79f549e07564, rack_id: b789fdaa-dfa9-4b88-b1cf-1807a37e31b9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1392024-08-27T23:42:08.724ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:a02a::1]:40236
1402024-08-27T23:42:08.724ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: b2ce5e72-9d59-4cfb-87ef-79f549e07564, rack_id: b789fdaa-dfa9-4b88-b1cf-1807a37e31b9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:359
1412024-08-27T23:42:08.724ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:374
1422024-08-27T23:42:08.724ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1432024-08-27T23:42:08.724ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:406
1442024-08-27T23:42:08.724ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:574
1452024-08-27T23:42:08.724ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
1462024-08-27T23:42:08.724ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1472024-08-27T23:42:08.724ZINFOSledAgent (StorageManager): No ledger in /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1482024-08-27T23:42:08.724ZINFOSledAgent (StorageManager): No ledger in /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1492024-08-27T23:42:08.724ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:563
1502024-08-27T23:42:08.724ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:591
1512024-08-27T23:42:08.724ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:395
1522024-08-27T23:42:08.724ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1532024-08-27T23:42:08.724ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:481 result = DisksManagementResult { status: [] }
1542024-08-27T23:42:08.726ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4158
1552024-08-27T23:42:08.726ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4540
1562024-08-27T23:42:08.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1572024-08-27T23:42:08.774ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:316
1582024-08-27T23:42:08.792ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1592024-08-27T23:42:08.803ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:385 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1602024-08-27T23:42:08.803ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1612024-08-27T23:42:08.803ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:397 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1622024-08-27T23:42:08.803ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1632024-08-27T23:42:08.807ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 138.5201ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "baa92ea1-0dfe-405b-b1dd-27d5d13599c9", "content-length": "124", "date": "Tue, 27 Aug 2024 23:42:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "baa92ea1-0dfe-405b-b1dd-27d5d13599c9" } file = clients/ddm-admin-client/src/lib.rs:177
1642024-08-27T23:42:08.818ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_3a897ff0-1a36-48cc-8f8f-7aa15f350d70/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1652024-08-27T23:42:08.842ZINFOSledAgent: successfully created encrypted zvol: name="oxi_3a897ff0-1a36-48cc-8f8f-7aa15f350d70/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1662024-08-27T23:42:08.842ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_3a897ff0-1a36-48cc-8f8f-7aa15f350d70/swap" file = sled-agent/src/swap_device.rs:96
1672024-08-27T23:42:08.847ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:412 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1682024-08-27T23:42:08.847ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1692024-08-27T23:42:08.847ZINFOSledAgent (BackingFs): Ensuring dataset oxi_3a897ff0-1a36-48cc-8f8f-7aa15f350d70/backing/fmd file = sled-agent/src/backing_fs.rs:136
1702024-08-27T23:42:08.917ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1712024-08-27T23:42:08.947ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1722024-08-27T23:42:08.947ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 176.825963ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9430581a-2f46-4905-b835-fecdb1f1a89d", "content-length": "124", "date": "Tue, 27 Aug 2024 23:42:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9430581a-2f46-4905-b835-fecdb1f1a89d" } file = clients/ddm-admin-client/src/lib.rs:177
1732024-08-27T23:42:09.126ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1742024-08-27T23:42:09.126ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 164.302233ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2bf11679-56ce-4caf-b0e2-d17a774c615d", "content-length": "124", "date": "Tue, 27 Aug 2024 23:42:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2bf11679-56ce-4caf-b0e2-d17a774c615d" } file = clients/ddm-admin-client/src/lib.rs:177
1752024-08-27T23:42:09.135ZINFOSledAgent (BackingFs): Mounting oxi_3a897ff0-1a36-48cc-8f8f-7aa15f350d70/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1762024-08-27T23:42:09.149ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1772024-08-27T23:42:09.149ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1782024-08-27T23:42:09.149ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1792024-08-27T23:42:09.149ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1802024-08-27T23:42:09.291ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1812024-08-27T23:42:09.292ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 216.509101ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e51e3fa6-53e0-44c3-a741-3361a8962fc8", "content-length": "124", "date": "Tue, 27 Aug 2024 23:42:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e51e3fa6-53e0-44c3-a741-3361a8962fc8" } file = clients/ddm-admin-client/src/lib.rs:177
1822024-08-27T23:42:09.510ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-08-27T23:42:09.511ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 190.458152ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "65b43dd8-9b01-4fbe-ad97-7c47e53c3c5c", "content-length": "124", "date": "Tue, 27 Aug 2024 23:42:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "65b43dd8-9b01-4fbe-ad97-7c47e53c3c5c" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-08-27T23:42:09.702ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1852024-08-27T23:42:09.703ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 168.246497ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4c0cca5d-c23c-468c-bb1e-69a0ee0e541f", "content-length": "124", "date": "Tue, 27 Aug 2024 23:42:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4c0cca5d-c23c-468c-bb1e-69a0ee0e541f" } file = clients/ddm-admin-client/src/lib.rs:177
1862024-08-27T23:42:09.873ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-08-27T23:42:09.883ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1882024-08-27T23:42:09.888ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:32940 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1892024-08-27T23:42:09.888ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1902024-08-27T23:42:09.888ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:32940 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1912024-08-27T23:42:09.889ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 191.320674ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1922024-08-27T23:42:09.891ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1932024-08-27T23:42:09.891ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1942024-08-27T23:42:09.891ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:915 underlay_address = fd00:1122:3344:101::1
1952024-08-27T23:42:09.891ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
1962024-08-27T23:42:10.082ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 316.502337ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1972024-08-27T23:42:10.401ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 720.95556ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1982024-08-27T23:42:11.124ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.1897914s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
1992024-08-27T23:42:12.244ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2634
2002024-08-27T23:42:12.244ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2852
2012024-08-27T23:42:12.244ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2504
2022024-08-27T23:42:12.244ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2551
2032024-08-27T23:42:12.244ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2933
2042024-08-27T23:42:12.244ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2975
2052024-08-27T23:42:12.246ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2777
2062024-08-27T23:42:12.247ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2545
2072024-08-27T23:42:12.247ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='064b4eb6-d3bf-422f-8262-496bedf7a20b'/> <propval type="astring" name="rack_id" value='b789fdaa-dfa9-4b88-b1cf-1807a37e31b9'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe55:a546'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='b2ce5e72-9d59-4cfb-87ef-79f549e07564'/> <propval type="astring" name="rack_id" value='b789fdaa-dfa9-4b88-b1cf-1807a37e31b9'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='b2ce5e72-9d59-4cfb-87ef-79f549e07564'/> <propval type="astring" name="rack_uuid" value='b789fdaa-dfa9-4b88-b1cf-1807a37e31b9'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='b2ce5e72-9d59-4cfb-87ef-79f549e07564'/> <propval type="astring" name="rack_uuid" value='b789fdaa-dfa9-4b88-b1cf-1807a37e31b9'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2082024-08-27T23:42:12.247ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2092024-08-27T23:42:12.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 66.987665ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2102024-08-27T23:42:12.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 123.955836ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2112024-08-27T23:42:12.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 128.729884ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2122024-08-27T23:42:13.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 549.818549ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2132024-08-27T23:42:13.316ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.243499508s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
2142024-08-27T23:42:13.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 549.451545ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2152024-08-27T23:42:14.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 949.839758ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-08-27T23:42:15.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.047117501s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-08-27T23:42:16.561ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.111523243s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
2182024-08-27T23:42:16.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.265073509s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-08-27T23:42:18.382ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:12345
2202024-08-27T23:42:18.382ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:429
2212024-08-27T23:42:18.382ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2222024-08-27T23:42:18.382ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2232024-08-27T23:42:18.382ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2242024-08-27T23:42:18.383ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2252024-08-27T23:42:18.383ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, local_pref: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None }], bgp: [], bfd: [] })))
2262024-08-27T23:42:18.383ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3861
2272024-08-27T23:42:18.383ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:a02a::1]:40236
2282024-08-27T23:42:18.383ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2292024-08-27T23:42:18.645ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2302024-08-27T23:42:18.645ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2312024-08-27T23:42:18.645ZINFOSledAgent (RSS): No ledger in /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/rss-service-plan-v4.json file = common/src/ledger.rs:188
2322024-08-27T23:42:18.645ZINFOSledAgent (RSS): No ledger in /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/rss-service-plan-v4.json file = common/src/ledger.rs:188
2332024-08-27T23:42:18.645ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2342024-08-27T23:42:18.645ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2352024-08-27T23:42:18.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2362024-08-27T23:42:18.650ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4182 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2372024-08-27T23:42:18.650ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4198
2382024-08-27T23:42:18.650ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2392024-08-27T23:42:18.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34679
2402024-08-27T23:42:18.891ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2412024-08-27T23:42:18.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34679 req_id = dc53c9b8-9c93-45a0-b630-b35375b03be0 response_code = 200 uri = /inventory
2422024-08-27T23:42:18.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61255
2432024-08-27T23:42:18.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61255 req_id = 2fb60346-e326-44e8-a594-7ddbc160eed9 response_code = 200 uri = /sled-role
2442024-08-27T23:42:18.923ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2452024-08-27T23:42:18.923ZINFOSledAgent (RSS): Writing ledger to /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/.rss-service-plan-v4.json.tmp file = common/src/ledger.rs:199
2462024-08-27T23:42:18.924ZINFOSledAgent (RSS): Writing ledger to /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/.rss-service-plan-v4.json.tmp file = common/src/ledger.rs:199
2472024-08-27T23:42:18.924ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:998
2482024-08-27T23:42:18.957ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 6e46683e-cdda-4c36-b75b-606cdbdc25a6, pool_id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: dc696d67-ed38-466d-9075-7e537dba0779, pool_id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 5fd67fac-c598-4b7f-b524-73b925c0362f, pool_id: 2f03970d-8389-493d-b912-73626b8d538f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: e73eb79b-ef41-4c8a-94fd-16635f81d336, pool_id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 6920077c-ac81-400d-9c05-bda21f8a4c9c, pool_id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 0b34f453-3cb7-4d76-a832-9ec79de0c247, pool_id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 9bcd938e-cc1b-4635-979e-bfd043771f64, pool_id: b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 6829f6f6-8735-4815-9c4a-a612380ae472, pool_id: 58f2cdae-319b-489c-89a1-9d6a173f3e8a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 9c669ea4-1918-4d06-988a-82e5e65e164a, pool_id: 6d2d4b30-dc11-496b-9bd8-e427a70cc372 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:355 sled_address = [fd00:1122:3344:101::1]:12345
2492024-08-27T23:42:18.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38842
2502024-08-27T23:42:18.957ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:830 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
2512024-08-27T23:42:18.957ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 6e46683e-cdda-4c36-b75b-606cdbdc25a6, pool_id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: dc696d67-ed38-466d-9075-7e537dba0779, pool_id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 5fd67fac-c598-4b7f-b524-73b925c0362f, pool_id: 2f03970d-8389-493d-b912-73626b8d538f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: e73eb79b-ef41-4c8a-94fd-16635f81d336, pool_id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 6920077c-ac81-400d-9c05-bda21f8a4c9c, pool_id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 0b34f453-3cb7-4d76-a832-9ec79de0c247, pool_id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 9bcd938e-cc1b-4635-979e-bfd043771f64, pool_id: b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 6829f6f6-8735-4815-9c4a-a612380ae472, pool_id: 58f2cdae-319b-489c-89a1-9d6a173f3e8a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 9c669ea4-1918-4d06-988a-82e5e65e164a, pool_id: 6d2d4b30-dc11-496b-9bd8-e427a70cc372 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:406
2522024-08-27T23:42:18.957ZINFOSledAgent (StorageManager): No ledger in /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2532024-08-27T23:42:18.957ZINFOSledAgent (StorageManager): No ledger in /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2542024-08-27T23:42:18.957ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:645 request = omicron_physical_disks_ensure
2552024-08-27T23:42:18.957ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2562024-08-27T23:42:18.957ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2572024-08-27T23:42:18.957ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2582024-08-27T23:42:18.957ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2592024-08-27T23:42:19.114ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:360
2602024-08-27T23:42:19.114ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 261199e3-73de-407f-8de5-043cbf4ed10d (zpool)
2612024-08-27T23:42:19.384ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
2622024-08-27T23:42:20.360ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
2632024-08-27T23:42:20.375ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }
2642024-08-27T23:42:20.383ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:351
2652024-08-27T23:42:20.383ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:353
2662024-08-27T23:42:20.383ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:357
2672024-08-27T23:42:20.383ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:359
2682024-08-27T23:42:20.383ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2692024-08-27T23:42:20.383ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2702024-08-27T23:42:20.383ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
2712024-08-27T23:42:20.387ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
2722024-08-27T23:42:20.416ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2732024-08-27T23:42:20.423ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_261199e3-73de-407f-8de5-043cbf4ed10d/crypt/zone file = sled-storage/src/dataset.rs:414
2742024-08-27T23:42:20.536ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_261199e3-73de-407f-8de5-043cbf4ed10d file = sled-storage/src/dataset.rs:499
2752024-08-27T23:42:20.544ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2762024-08-27T23:42:20.544ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2772024-08-27T23:42:20.544ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2782024-08-27T23:42:20.544ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2792024-08-27T23:42:20.544ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2802024-08-27T23:42:20.554ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:360
2812024-08-27T23:42:20.554ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool)
2822024-08-27T23:42:20.649ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }
2832024-08-27T23:42:20.657ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:351
2842024-08-27T23:42:20.657ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:353
2852024-08-27T23:42:20.657ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:357
2862024-08-27T23:42:20.657ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:359
2872024-08-27T23:42:20.657ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-08-27T23:42:20.657ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-08-27T23:42:20.657ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
2902024-08-27T23:42:20.694ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-08-27T23:42:20.702ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f5032ea4-6112-4732-b8ee-8f60011c0e16/crypt/zone file = sled-storage/src/dataset.rs:414
2922024-08-27T23:42:20.823ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f5032ea4-6112-4732-b8ee-8f60011c0e16 file = sled-storage/src/dataset.rs:499
2932024-08-27T23:42:20.831ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2942024-08-27T23:42:20.831ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2952024-08-27T23:42:20.831ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2962024-08-27T23:42:20.831ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2972024-08-27T23:42:20.831ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
2982024-08-27T23:42:20.840ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:360
2992024-08-27T23:42:20.840ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 2f03970d-8389-493d-b912-73626b8d538f (zpool)
3002024-08-27T23:42:20.928ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }
3012024-08-27T23:42:20.935ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:351
3022024-08-27T23:42:20.935ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:353
3032024-08-27T23:42:20.935ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:357
3042024-08-27T23:42:20.935ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:359
3052024-08-27T23:42:20.935ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3062024-08-27T23:42:20.935ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-08-27T23:42:20.935ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
3082024-08-27T23:42:20.967ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3092024-08-27T23:42:20.974ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2f03970d-8389-493d-b912-73626b8d538f/crypt/zone file = sled-storage/src/dataset.rs:414
3102024-08-27T23:42:21.089ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2f03970d-8389-493d-b912-73626b8d538f file = sled-storage/src/dataset.rs:499
3112024-08-27T23:42:21.096ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3122024-08-27T23:42:21.096ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3132024-08-27T23:42:21.096ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3142024-08-27T23:42:21.096ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3152024-08-27T23:42:21.096ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3162024-08-27T23:42:21.106ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:360
3172024-08-27T23:42:21.106ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool)
3182024-08-27T23:42:21.200ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External }
3192024-08-27T23:42:21.208ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:351
3202024-08-27T23:42:21.208ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:353
3212024-08-27T23:42:21.208ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:357
3222024-08-27T23:42:21.208ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:359
3232024-08-27T23:42:21.208ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3242024-08-27T23:42:21.209ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-08-27T23:42:21.209ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
3262024-08-27T23:42:21.245ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3272024-08-27T23:42:21.254ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_01024d79-0997-4738-a4d3-daf5c97d6e9d/crypt/zone file = sled-storage/src/dataset.rs:414
3282024-08-27T23:42:21.383ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_01024d79-0997-4738-a4d3-daf5c97d6e9d file = sled-storage/src/dataset.rs:499
3292024-08-27T23:42:21.389ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
3302024-08-27T23:42:21.392ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3312024-08-27T23:42:21.392ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3322024-08-27T23:42:21.392ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3332024-08-27T23:42:21.392ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3342024-08-27T23:42:21.392ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3352024-08-27T23:42:21.402ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:360
3362024-08-27T23:42:21.402ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool)
3372024-08-27T23:42:21.495ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External }
3382024-08-27T23:42:21.503ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:351
3392024-08-27T23:42:21.503ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:353
3402024-08-27T23:42:21.503ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:357
3412024-08-27T23:42:21.503ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:359
3422024-08-27T23:42:21.503ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-08-27T23:42:21.503ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-08-27T23:42:21.503ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
3452024-08-27T23:42:21.537ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3462024-08-27T23:42:21.546ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2440f700-b74a-4ef3-85b8-62d810b4ecb0/crypt/zone file = sled-storage/src/dataset.rs:414
3472024-08-27T23:42:21.674ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2440f700-b74a-4ef3-85b8-62d810b4ecb0 file = sled-storage/src/dataset.rs:499
3482024-08-27T23:42:21.683ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3492024-08-27T23:42:21.683ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3502024-08-27T23:42:21.683ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3512024-08-27T23:42:21.683ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3522024-08-27T23:42:21.683ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3532024-08-27T23:42:21.693ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:360
3542024-08-27T23:42:21.693ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 1df19093-a749-4394-9c32-b41d22eaa752 (zpool)
3552024-08-27T23:42:21.791ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool), kind: External }
3562024-08-27T23:42:21.800ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:351
3572024-08-27T23:42:21.800ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:353
3582024-08-27T23:42:21.800ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:357
3592024-08-27T23:42:21.801ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:359
3602024-08-27T23:42:21.801ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3612024-08-27T23:42:21.801ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-08-27T23:42:21.801ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
3632024-08-27T23:42:21.837ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3642024-08-27T23:42:21.845ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1df19093-a749-4394-9c32-b41d22eaa752/crypt/zone file = sled-storage/src/dataset.rs:414
3652024-08-27T23:42:21.967ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1df19093-a749-4394-9c32-b41d22eaa752 file = sled-storage/src/dataset.rs:499
3662024-08-27T23:42:21.975ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3672024-08-27T23:42:21.975ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3682024-08-27T23:42:21.975ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3692024-08-27T23:42:21.975ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3702024-08-27T23:42:21.975ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3712024-08-27T23:42:21.985ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:360
3722024-08-27T23:42:21.985ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5 (zpool)
3732024-08-27T23:42:22.090ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5 (zpool), kind: External }
3742024-08-27T23:42:22.098ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:351
3752024-08-27T23:42:22.098ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:353
3762024-08-27T23:42:22.098ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:357
3772024-08-27T23:42:22.098ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:359
3782024-08-27T23:42:22.098ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3792024-08-27T23:42:22.098ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-08-27T23:42:22.098ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
3812024-08-27T23:42:22.134ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3822024-08-27T23:42:22.142ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5/crypt/zone file = sled-storage/src/dataset.rs:414
3832024-08-27T23:42:22.258ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5 file = sled-storage/src/dataset.rs:499
3842024-08-27T23:42:22.266ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3852024-08-27T23:42:22.266ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3862024-08-27T23:42:22.266ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3872024-08-27T23:42:22.266ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3882024-08-27T23:42:22.266ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3892024-08-27T23:42:22.276ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:360
3902024-08-27T23:42:22.276ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 58f2cdae-319b-489c-89a1-9d6a173f3e8a (zpool)
3912024-08-27T23:42:22.373ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 58f2cdae-319b-489c-89a1-9d6a173f3e8a (zpool), kind: External }
3922024-08-27T23:42:22.381ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:351
3932024-08-27T23:42:22.381ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:353
3942024-08-27T23:42:22.381ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:357
3952024-08-27T23:42:22.381ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:359
3962024-08-27T23:42:22.382ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3972024-08-27T23:42:22.382ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-08-27T23:42:22.382ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
3992024-08-27T23:42:22.392ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
4002024-08-27T23:42:22.417ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4012024-08-27T23:42:22.425ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_58f2cdae-319b-489c-89a1-9d6a173f3e8a/crypt/zone file = sled-storage/src/dataset.rs:414
4022024-08-27T23:42:22.548ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_58f2cdae-319b-489c-89a1-9d6a173f3e8a file = sled-storage/src/dataset.rs:499
4032024-08-27T23:42:22.556ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4042024-08-27T23:42:22.556ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4052024-08-27T23:42:22.556ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4062024-08-27T23:42:22.556ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4072024-08-27T23:42:22.556ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4082024-08-27T23:42:22.566ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:360
4092024-08-27T23:42:22.566ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 6d2d4b30-dc11-496b-9bd8-e427a70cc372 (zpool)
4102024-08-27T23:42:22.662ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 6d2d4b30-dc11-496b-9bd8-e427a70cc372 (zpool), kind: External }
4112024-08-27T23:42:22.670ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:351
4122024-08-27T23:42:22.670ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:353
4132024-08-27T23:42:22.670ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:357
4142024-08-27T23:42:22.670ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:359
4152024-08-27T23:42:22.670ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4162024-08-27T23:42:22.670ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-08-27T23:42:22.670ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
4182024-08-27T23:42:22.705ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4192024-08-27T23:42:22.713ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6d2d4b30-dc11-496b-9bd8-e427a70cc372/crypt/zone file = sled-storage/src/dataset.rs:414
4202024-08-27T23:42:22.834ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6d2d4b30-dc11-496b-9bd8-e427a70cc372 file = sled-storage/src/dataset.rs:499
4212024-08-27T23:42:22.842ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4222024-08-27T23:42:22.842ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4232024-08-27T23:42:22.842ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4242024-08-27T23:42:22.842ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3a897ff0-1a36-48cc-8f8f-7aa15f350d70 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 58f2cdae-319b-489c-89a1-9d6a173f3e8a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 6d2d4b30-dc11-496b-9bd8-e427a70cc372 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4252024-08-27T23:42:22.842ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4262024-08-27T23:42:22.842ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4272024-08-27T23:42:22.842ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282024-08-27T23:42:22.842ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:834 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
4292024-08-27T23:42:22.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4302024-08-27T23:42:22.842ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:860 generation = Generation(1) sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
4312024-08-27T23:42:22.842ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:865 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
4322024-08-27T23:42:22.842ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:870 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
4332024-08-27T23:42:22.842ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:121 gen = Generation(1) sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
4342024-08-27T23:42:22.842ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:876 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
4352024-08-27T23:42:22.842ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:803 gen = Generation(1)
4362024-08-27T23:42:22.842ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:881 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
4372024-08-27T23:42:22.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3885494 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38842 req_id = 2ae91072-be17-4590-81dd-7cf0bd16b16c response_code = 200 uri = /omicron-physical-disks
4382024-08-27T23:42:22.874ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
4392024-08-27T23:42:22.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48283
4402024-08-27T23:42:22.874ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
4412024-08-27T23:42:22.874ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: InternalDns }, responder: ... }
4422024-08-27T23:42:22.925ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
4432024-08-27T23:42:22.925ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4442024-08-27T23:42:22.974ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
4452024-08-27T23:42:22.974ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: InternalDns }, responder: ... }
4462024-08-27T23:42:23.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4472024-08-27T23:42:23.022ZINFOSledAgent (ServiceManager): No ledger in /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/omicron-zones.json file = common/src/ledger.rs:188
4482024-08-27T23:42:23.022ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/omicron-zones.json file = common/src/ledger.rs:188
4492024-08-27T23:42:23.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4502024-08-27T23:42:23.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4512024-08-27T23:42:23.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4522024-08-27T23:42:23.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4532024-08-27T23:42:23.114ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34 file = illumos-utils/src/zone.rs:316
4542024-08-27T23:42:23.117ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10 file = illumos-utils/src/zone.rs:316
4552024-08-27T23:42:23.121ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff file = illumos-utils/src/zone.rs:316
4562024-08-27T23:42:23.135ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34 file = illumos-utils/src/zone.rs:354
4572024-08-27T23:42:23.139ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10 file = illumos-utils/src/zone.rs:354
4582024-08-27T23:42:23.143ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff file = illumos-utils/src/zone.rs:354
4592024-08-27T23:42:23.395ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
4602024-08-27T23:42:24.625ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4612024-08-27T23:42:24.625ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4622024-08-27T23:42:24.625ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10
4632024-08-27T23:42:25.109ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4642024-08-27T23:42:25.109ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4652024-08-27T23:42:25.589ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4662024-08-27T23:42:25.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10") failed: Property not found. retry in 27.014537ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10
4672024-08-27T23:42:25.596ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff
4682024-08-27T23:42:25.600ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4692024-08-27T23:42:25.600ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34
4702024-08-27T23:42:25.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10") failed: Property not found. retry in 109.450316ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10
4712024-08-27T23:42:25.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff") failed: Property not found. retry in 59.219977ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff
4722024-08-27T23:42:25.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34") failed: Property not found. retry in 53.09038ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34
4732024-08-27T23:42:25.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10") failed: Property not found. retry in 205.6369ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10
4742024-08-27T23:42:25.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34") failed: Property not found. retry in 102.501799ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34
4752024-08-27T23:42:25.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff") failed: Property not found. retry in 135.034549ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff
4762024-08-27T23:42:25.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34") failed: Property not found. retry in 149.922783ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34
4772024-08-27T23:42:25.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10") failed: Property not found. retry in 282.004197ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10
4782024-08-27T23:42:26.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff") failed: Property not found. retry in 239.20282ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff
4792024-08-27T23:42:26.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34") failed: Property not found. retry in 371.33042ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34
4802024-08-27T23:42:26.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10") failed: Property not found. retry in 771.017023ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10
4812024-08-27T23:42:26.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff") failed: Property not found. retry in 444.394256ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff
4822024-08-27T23:42:26.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34") failed: Property not found. retry in 1.068667717s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34
4832024-08-27T23:42:26.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff") failed: Property not found. retry in 1.163505155s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff
4842024-08-27T23:42:27.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10") failed: Property not found. retry in 1.393000222s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10
4852024-08-27T23:42:27.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34") failed: Property not found. retry in 1.085720293s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34
4862024-08-27T23:42:27.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff") failed: Property not found. retry in 998.082367ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff
4872024-08-27T23:42:28.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10") failed: Property not found. retry in 1.002458965s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10
4882024-08-27T23:42:28.601ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4206
4892024-08-27T23:42:28.601ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4216 gateway = fd00:1122:3344:101::1
4902024-08-27T23:42:28.606ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4295
4912024-08-27T23:42:28.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34") failed: Property not found. retry in 676.672189ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34
4922024-08-27T23:42:28.728ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4343
4932024-08-27T23:42:28.728ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4370
4942024-08-27T23:42:28.766ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4383
4952024-08-27T23:42:28.766ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4247
4962024-08-27T23:42:28.823ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4289
4972024-08-27T23:42:28.823ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4350 rack_subnet = fd00:1122:3344::
4982024-08-27T23:42:28.846ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4361
4992024-08-27T23:42:28.846ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4403
5002024-08-27T23:42:28.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff") failed: Property not found. retry in 1.496860747s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff
5012024-08-27T23:42:28.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:34789
5022024-08-27T23:42:28.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:34789 req_id = 1fa0b3c4-6ed3-448a-8fd4-b61f2138ab9d response_code = 200 uri = /sled-identifiers
5032024-08-27T23:42:28.948ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4435
5042024-08-27T23:42:28.948ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4441
5052024-08-27T23:42:29.083ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4482
5062024-08-27T23:42:29.083ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:366
5072024-08-27T23:42:29.115ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:571 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
5082024-08-27T23:42:29.116ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:414
5092024-08-27T23:42:29.148ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:676
5102024-08-27T23:42:29.148ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:714
5112024-08-27T23:42:29.149ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:717 uptime = 1
5122024-08-27T23:42:29.149ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:436
5132024-08-27T23:42:29.185ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
5142024-08-27T23:42:29.236ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:406
5152024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5162024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5172024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5182024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5192024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5202024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5212024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5222024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5232024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5242024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5252024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5262024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5272024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5282024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5292024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5302024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5312024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5322024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5332024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5342024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5352024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5362024-08-27T23:42:29.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5372024-08-27T23:42:29.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34") failed: Property not found. retry in 880.291077ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34
5382024-08-27T23:42:29.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10") failed: Property not found. retry in 598.250478ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10
5392024-08-27T23:42:30.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10") failed: Property not found. retry in 777.542088ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10
5402024-08-27T23:42:30.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34") failed: Property not found. retry in 942.34459ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34
5412024-08-27T23:42:30.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff") failed: Property not found. retry in 1.326356879s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff
5422024-08-27T23:42:31.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_internal_dns_7b11310a-3cc7-43bf-ac4f-db028dcd8a34
5432024-08-27T23:42:31.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_internal_dns_8cdf4291-7757-408c-bbb0-c3c5eefecf10
5442024-08-27T23:42:31.762ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_internal_dns_7d7c6d61-8eaf-4143-bf91-a51873d614ff
5452024-08-27T23:42:31.762ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5462024-08-27T23:42:31.762ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5472024-08-27T23:42:31.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8888733 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48283 req_id = 1106fa16-000a-4c55-ac2f-2195c2d23ba5 response_code = 204 uri = /omicron-zones
5482024-08-27T23:42:31.765ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5492024-08-27T23:42:31.813ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5502024-08-27T23:42:31.858ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5512024-08-27T23:42:31.910ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:591
5522024-08-27T23:42:31.910ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5532024-08-27T23:42:31.943ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5542024-08-27T23:42:31.944ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5552024-08-27T23:42:31.944ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5562024-08-27T23:42:31.973ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 39068454-e35d-4556-9935-1e87200d5f74, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 44b417dc-69af-4658-9946-22e1f17c0b4d, kind: Service { id: 39068454-e35d-4556-9935-1e87200d5f74 }, name: Name("ntp-39068454-e35d-4556-9935-1e87200d5f74"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 50])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
5572024-08-27T23:42:31.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51940
5582024-08-27T23:42:31.973ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
5592024-08-27T23:42:31.973ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: InternalDns }, responder: ... }
5602024-08-27T23:42:31.994ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
5612024-08-27T23:42:31.994ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5622024-08-27T23:42:32.013ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
5632024-08-27T23:42:32.013ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: InternalDns }, responder: ... }
5642024-08-27T23:42:32.032ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
5652024-08-27T23:42:32.032ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/omicron-zones.json file = common/src/ledger.rs:177
5662024-08-27T23:42:32.032ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/omicron-zones.json file = common/src/ledger.rs:177
5672024-08-27T23:42:32.032ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
5682024-08-27T23:42:32.043ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5692024-08-27T23:42:32.077ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5702024-08-27T23:42:32.078ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5712024-08-27T23:42:32.078ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5722024-08-27T23:42:32.108ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 249, 50]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5732024-08-27T23:42:32.108ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = boundary_ntp
5742024-08-27T23:42:32.109ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
5752024-08-27T23:42:32.109ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
5762024-08-27T23:42:32.109ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
5772024-08-27T23:42:32.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
5782024-08-27T23:42:32.133ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74 file = illumos-utils/src/zone.rs:316
5792024-08-27T23:42:32.150ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74 file = illumos-utils/src/zone.rs:354
5802024-08-27T23:42:32.767ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5812024-08-27T23:42:32.767ZINFOSledAgent (ServiceManager): Booting oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74
5822024-08-27T23:42:32.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74") failed: Property not found. retry in 65.188872ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74
5832024-08-27T23:42:32.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74") failed: Property not found. retry in 98.487437ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74
5842024-08-27T23:42:33.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74") failed: Property not found. retry in 141.664769ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74
5852024-08-27T23:42:33.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74") failed: Property not found. retry in 317.88679ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74
5862024-08-27T23:42:33.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74") failed: Property not found. retry in 684.913061ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74
5872024-08-27T23:42:34.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74") failed: Property not found. retry in 1.026966732s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74
5882024-08-27T23:42:35.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74") failed: Property not found. retry in 703.450273ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74
5892024-08-27T23:42:36.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74") failed: Property not found. retry in 1.061263135s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74
5902024-08-27T23:42:37.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74") failed: Property not found. retry in 709.053638ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74
5912024-08-27T23:42:37.837ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74
5922024-08-27T23:42:37.837ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5932024-08-27T23:42:37.837ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5942024-08-27T23:42:37.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5864714 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51940 req_id = 274f87d6-0220-45f8-8bfb-17a4ec85b77e response_code = 204 uri = /omicron-zones
5952024-08-27T23:42:37.840ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:632
5962024-08-27T23:42:37.871ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
5972024-08-27T23:42:37.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47725
5982024-08-27T23:42:37.880ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3847
5992024-08-27T23:42:37.881ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 8974 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47725 req_id = 13325f1f-7450-44c6-9d32-ed1f65e3be29 response_code = 500 uri = /timesync
6002024-08-27T23:42:37.883ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6012024-08-27T23:42:37.971ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6022024-08-27T23:42:37.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40119
6032024-08-27T23:42:41.981ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3847
6042024-08-27T23:42:41.981ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 4009286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40119 req_id = 580393c7-4965-41f0-9cce-c2a168b2d640 response_code = 500 uri = /timesync
6052024-08-27T23:42:41.985ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6062024-08-27T23:42:42.123ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6072024-08-27T23:42:42.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46056
6082024-08-27T23:42:42.132ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3847
6092024-08-27T23:42:42.132ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 8760 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46056 req_id = 5cc58276-eb44-4534-a670-6a728263c0ae response_code = 500 uri = /timesync
6102024-08-27T23:42:42.135ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6112024-08-27T23:42:42.376ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6122024-08-27T23:42:42.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58749
6132024-08-27T23:42:42.384ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_39068454-e35d-4556-9935-1e87200d5f74': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3847
6142024-08-27T23:42:42.384ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 7994 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58749 req_id = df74ce0b-cb67-49b7-9a1c-6e763fcc1f91 response_code = 500 uri = /timesync
6152024-08-27T23:42:42.386ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6162024-08-27T23:42:42.570ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6172024-08-27T23:42:42.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40313
6182024-08-27T23:42:46.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4008092 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40313 req_id = a7fa6fe3-6c96-4fcd-bd9d-36094c14c321 response_code = 200 uri = /timesync
6192024-08-27T23:42:46.216ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6202024-08-27T23:42:46.216ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6212024-08-27T23:42:46.527ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6222024-08-27T23:42:46.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51548
6232024-08-27T23:42:46.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51548 req_id = 8f5171f7-37e1-41d0-b213-f7293dfe437f response_code = 200 uri = /timesync
6242024-08-27T23:42:46.537ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6252024-08-27T23:42:46.537ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6262024-08-27T23:42:46.736ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6272024-08-27T23:42:46.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61783
6282024-08-27T23:42:46.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8794 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61783 req_id = cb57da4a-3666-4c41-8fdb-abde671e9fc4 response_code = 200 uri = /timesync
6292024-08-27T23:42:46.747ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6302024-08-27T23:42:46.747ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6312024-08-27T23:42:46.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6322024-08-27T23:42:46.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51070
6332024-08-27T23:42:47.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51070 req_id = d895d451-7550-4455-9629-bca1e3570391 response_code = 200 uri = /timesync
6342024-08-27T23:42:47.004ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6352024-08-27T23:42:47.004ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6362024-08-27T23:42:47.321ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 274.05023ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
6372024-08-27T23:42:47.403ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6382024-08-27T23:42:47.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33225
6392024-08-27T23:42:47.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7796 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33225 req_id = 6c38e4ea-70e4-4db6-a32b-34ede4a16a4c response_code = 200 uri = /timesync
6402024-08-27T23:42:47.412ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6412024-08-27T23:42:47.412ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6422024-08-27T23:42:47.981ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6432024-08-27T23:42:47.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41752
6442024-08-27T23:42:47.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8462 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41752 req_id = 5fad80c5-9b3e-4ab3-8506-301cd069b902 response_code = 200 uri = /timesync
6452024-08-27T23:42:47.994ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.153264239 } file = sled-agent/src/rack_setup/service.rs:640
6462024-08-27T23:42:47.994ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6472024-08-27T23:42:48.592ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6482024-08-27T23:42:48.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33787
6492024-08-27T23:42:48.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8054 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33787 req_id = 46379c5f-dc0f-4ef4-a6d0-82e7868de041 response_code = 200 uri = /timesync
6502024-08-27T23:42:48.603ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.151616141 } file = sled-agent/src/rack_setup/service.rs:640
6512024-08-27T23:42:48.603ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6522024-08-27T23:42:49.131ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6532024-08-27T23:42:49.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51948
6542024-08-27T23:42:49.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51948 req_id = b2591ac0-88d0-415b-bcc0-fc192f16ac9e response_code = 200 uri = /timesync
6552024-08-27T23:42:49.141ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.19037047 } file = sled-agent/src/rack_setup/service.rs:640
6562024-08-27T23:42:49.141ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6572024-08-27T23:42:49.943ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6582024-08-27T23:42:49.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56892
6592024-08-27T23:42:49.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8771 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56892 req_id = ec09eb6c-629c-4c44-adb7-4139e2f7e647 response_code = 200 uri = /timesync
6602024-08-27T23:42:49.955ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.159367159 } file = sled-agent/src/rack_setup/service.rs:640
6612024-08-27T23:42:49.955ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6622024-08-27T23:42:51.308ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6632024-08-27T23:42:51.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41420
6642024-08-27T23:42:51.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7919 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41420 req_id = d4743204-9d02-4cd6-9bd7-f58761b7f000 response_code = 200 uri = /timesync
6652024-08-27T23:42:51.318ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.157981098 } file = sled-agent/src/rack_setup/service.rs:640
6662024-08-27T23:42:51.318ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6672024-08-27T23:42:52.480ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6682024-08-27T23:42:52.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48773
6692024-08-27T23:42:52.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8642 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48773 req_id = de5d82cd-b018-4a76-9666-c51ddd1faa28 response_code = 200 uri = /timesync
6702024-08-27T23:42:52.493ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.152924553 } file = sled-agent/src/rack_setup/service.rs:640
6712024-08-27T23:42:52.493ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6722024-08-27T23:42:53.712ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6732024-08-27T23:42:53.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61222
6742024-08-27T23:42:53.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61222 req_id = cd511807-139b-4748-922d-6bc17578b278 response_code = 200 uri = /timesync
6752024-08-27T23:42:53.724ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.149187282 } file = sled-agent/src/rack_setup/service.rs:640
6762024-08-27T23:42:53.724ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6772024-08-27T23:42:55.524ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6782024-08-27T23:42:55.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63811
6792024-08-27T23:42:55.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63811 req_id = 212facf9-5f49-4ae1-b991-d38581644faa response_code = 200 uri = /timesync
6802024-08-27T23:42:55.535ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.142195582 } file = sled-agent/src/rack_setup/service.rs:640
6812024-08-27T23:42:55.535ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6822024-08-27T23:42:58.305ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6832024-08-27T23:42:58.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46208
6842024-08-27T23:42:58.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8411 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46208 req_id = 563ac53a-8b31-4a55-a123-993f216a7ddf response_code = 200 uri = /timesync
6852024-08-27T23:42:58.316ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.135783017 } file = sled-agent/src/rack_setup/service.rs:640
6862024-08-27T23:42:58.316ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6872024-08-27T23:42:58.441ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39084
6882024-08-27T23:42:58.441ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39084 req_id = 4ace26ed-9c00-40bd-be46-5fcc52f440b8 response_code = 200 uri = /baseboard
6892024-08-27T23:43:01.165ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6902024-08-27T23:43:01.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52161
6912024-08-27T23:43:01.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8968 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52161 req_id = c2ea9def-48dd-415f-9602-0c6013df24e8 response_code = 200 uri = /timesync
6922024-08-27T23:43:01.177ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.115637429 } file = sled-agent/src/rack_setup/service.rs:640
6932024-08-27T23:43:01.177ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6942024-08-27T23:43:02.671ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 350.423461ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
6952024-08-27T23:43:04.337ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6962024-08-27T23:43:04.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34828
6972024-08-27T23:43:04.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8673 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34828 req_id = 4f69916b-4a73-44da-aea9-4a45b26fe28c response_code = 200 uri = /timesync
6982024-08-27T23:43:04.350ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724802163.549901, correction: 0.116565302 } file = sled-agent/src/rack_setup/service.rs:640
6992024-08-27T23:43:04.350ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7002024-08-27T23:43:06.554ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7012024-08-27T23:43:06.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33940
7022024-08-27T23:43:06.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8692 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33940 req_id = f638e75e-440f-46cb-8984-ad0be0f8aaa8 response_code = 200 uri = /timesync
7032024-08-27T23:43:06.566ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1724802185.7667294, correction: 0.112911858 } file = sled-agent/src/rack_setup/service.rs:640
7042024-08-27T23:43:06.566ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7052024-08-27T23:43:09.158ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7062024-08-27T23:43:09.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42977
7072024-08-27T23:43:09.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8771 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42977 req_id = 8f5e55a3-ebd0-478e-ac3c-72cb97a0f91e response_code = 200 uri = /timesync
7082024-08-27T23:43:09.171ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1724802186.1731195, correction: 0.105847627 } file = sled-agent/src/rack_setup/service.rs:640
7092024-08-27T23:43:09.171ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7102024-08-27T23:43:12.495ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7112024-08-27T23:43:12.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35250
7122024-08-27T23:43:12.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8820 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35250 req_id = 745d6c57-1c47-47b2-85dc-d574360d94a4 response_code = 200 uri = /timesync
7132024-08-27T23:43:12.508ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1724802191.367153, correction: 0.096794531 } file = sled-agent/src/rack_setup/service.rs:640
7142024-08-27T23:43:12.508ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7152024-08-27T23:43:16.941ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7162024-08-27T23:43:16.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50083
7172024-08-27T23:43:16.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8084 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50083 req_id = 515c3961-c904-4c6d-af88-0a281445b583 response_code = 200 uri = /timesync
7182024-08-27T23:43:16.951ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1724802196.3241265, correction: 0.085095525 } file = sled-agent/src/rack_setup/service.rs:640
7192024-08-27T23:43:16.951ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7202024-08-27T23:43:18.098ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 824.729562ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
7212024-08-27T23:43:22.246ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7222024-08-27T23:43:22.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37451
7232024-08-27T23:43:22.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9641 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37451 req_id = 0678a2f3-fa71-4e5a-9cd0-72ae40660a0a response_code = 200 uri = /timesync
7242024-08-27T23:43:22.259ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1724802200.3324757, correction: 0.070815794 } file = sled-agent/src/rack_setup/service.rs:640
7252024-08-27T23:43:22.259ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7262024-08-27T23:43:28.556ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36911
7272024-08-27T23:43:28.556ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36911 req_id = 368415ab-9247-4d53-bfce-6fabded483ef response_code = 200 uri = /baseboard
7282024-08-27T23:43:31.102ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7292024-08-27T23:43:31.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48165
7302024-08-27T23:43:31.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 21620 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48165 req_id = 3a3b260e-6414-486d-b427-14c414346488 response_code = 200 uri = /timesync
7312024-08-27T23:43:31.127ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1724802208.46357, correction: 0.046929486 } file = sled-agent/src/rack_setup/service.rs:640
7322024-08-27T23:43:31.127ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1266
7332024-08-27T23:43:31.157ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 39068454-e35d-4556-9935-1e87200d5f74, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 44b417dc-69af-4658-9946-22e1f17c0b4d, kind: Service { id: 39068454-e35d-4556-9935-1e87200d5f74 }, name: Name("ntp-39068454-e35d-4556-9935-1e87200d5f74"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 50])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: cc411e47-bdc9-403c-ae1c-616181089982, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External } } } }, OmicronZoneConfig { id: 530ea6e4-b11e-441b-a518-f6b90d2d6b32, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7bfa68fd-e941-45c7-ba90-ad8dccbdde73, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External } } } }, OmicronZoneConfig { id: d20d1d5e-5755-4059-be76-f4c626bbc773, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External } } } }, OmicronZoneConfig { id: 3bdb362e-343e-49ce-a450-de72f0e46b83, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
7342024-08-27T23:43:31.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39772
7352024-08-27T23:43:31.158ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
7362024-08-27T23:43:31.158ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: InternalDns }, responder: ... }
7372024-08-27T23:43:31.179ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
7382024-08-27T23:43:31.179ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7392024-08-27T23:43:31.196ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
7402024-08-27T23:43:31.196ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: InternalDns }, responder: ... }
7412024-08-27T23:43:31.216ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cc411e47-bdc9-403c-ae1c-616181089982, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7422024-08-27T23:43:31.216ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: cc411e47-bdc9-403c-ae1c-616181089982, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7432024-08-27T23:43:31.269ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 530ea6e4-b11e-441b-a518-f6b90d2d6b32, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7442024-08-27T23:43:31.269ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 530ea6e4-b11e-441b-a518-f6b90d2d6b32, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7452024-08-27T23:43:31.323ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7bfa68fd-e941-45c7-ba90-ad8dccbdde73, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7462024-08-27T23:43:31.323ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 7bfa68fd-e941-45c7-ba90-ad8dccbdde73, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7472024-08-27T23:43:31.371ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d20d1d5e-5755-4059-be76-f4c626bbc773, dataset_name: DatasetName { pool_name: ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7482024-08-27T23:43:31.371ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: d20d1d5e-5755-4059-be76-f4c626bbc773, dataset_name: DatasetName { pool_name: ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7492024-08-27T23:43:31.421ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3bdb362e-343e-49ce-a450-de72f0e46b83, dataset_name: DatasetName { pool_name: ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7502024-08-27T23:43:31.421ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 3bdb362e-343e-49ce-a450-de72f0e46b83, dataset_name: DatasetName { pool_name: ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7512024-08-27T23:43:31.473ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7522024-08-27T23:43:31.473ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/omicron-zones.json file = common/src/ledger.rs:177
7532024-08-27T23:43:31.473ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/omicron-zones.json file = common/src/ledger.rs:177
7542024-08-27T23:43:31.473ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7552024-08-27T23:43:31.555ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7562024-08-27T23:43:31.555ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7572024-08-27T23:43:31.555ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7582024-08-27T23:43:31.555ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7592024-08-27T23:43:31.555ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7602024-08-27T23:43:31.646ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73 file = illumos-utils/src/zone.rs:316
7612024-08-27T23:43:31.650ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982 file = illumos-utils/src/zone.rs:316
7622024-08-27T23:43:31.654ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32 file = illumos-utils/src/zone.rs:316
7632024-08-27T23:43:31.658ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83 file = illumos-utils/src/zone.rs:316
7642024-08-27T23:43:31.663ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773 file = illumos-utils/src/zone.rs:316
7652024-08-27T23:43:31.667ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73 file = illumos-utils/src/zone.rs:354
7662024-08-27T23:43:31.671ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982 file = illumos-utils/src/zone.rs:354
7672024-08-27T23:43:31.676ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32 file = illumos-utils/src/zone.rs:354
7682024-08-27T23:43:31.680ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83 file = illumos-utils/src/zone.rs:354
7692024-08-27T23:43:31.686ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773 file = illumos-utils/src/zone.rs:354
7702024-08-27T23:43:34.000ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.312042977s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
7712024-08-27T23:43:34.695ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d20d1d5e-5755-4059-be76-f4c626bbc773'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7722024-08-27T23:43:34.695ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
7732024-08-27T23:43:34.705ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7bfa68fd-e941-45c7-ba90-ad8dccbdde73'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7742024-08-27T23:43:34.705ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
7752024-08-27T23:43:34.721ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='530ea6e4-b11e-441b-a518-f6b90d2d6b32'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7762024-08-27T23:43:34.721ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
7772024-08-27T23:43:34.731ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cc411e47-bdc9-403c-ae1c-616181089982'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7782024-08-27T23:43:34.731ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
7792024-08-27T23:43:34.772ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3bdb362e-343e-49ce-a450-de72f0e46b83'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7802024-08-27T23:43:34.772ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
7812024-08-27T23:43:34.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 51.440358ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
7822024-08-27T23:43:34.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 63.653022ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
7832024-08-27T23:43:34.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 62.368766ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
7842024-08-27T23:43:34.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 59.492908ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
7852024-08-27T23:43:34.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 104.60317ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
7862024-08-27T23:43:35.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 68.265165ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
7872024-08-27T23:43:35.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 107.096309ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
7882024-08-27T23:43:35.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 137.966233ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
7892024-08-27T23:43:35.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 70.209312ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
7902024-08-27T23:43:35.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 103.197709ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
7912024-08-27T23:43:36.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 249.223018ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
7922024-08-27T23:43:37.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 256.202483ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
7932024-08-27T23:43:37.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 226.692371ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
7942024-08-27T23:43:37.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 122.940257ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
7952024-08-27T23:43:37.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 278.894696ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
7962024-08-27T23:43:37.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 412.665754ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
7972024-08-27T23:43:37.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 203.204628ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
7982024-08-27T23:43:37.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 538.873724ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
7992024-08-27T23:43:37.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 233.417532ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8002024-08-27T23:43:37.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 325.656954ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
8012024-08-27T23:43:37.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 540.287186ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8022024-08-27T23:43:38.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 690.810207ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
8032024-08-27T23:43:38.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 499.960308ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8042024-08-27T23:43:38.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 938.606644ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
8052024-08-27T23:43:38.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 864.433887ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
8062024-08-27T23:43:38.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 1.272251478s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8072024-08-27T23:43:38.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 863.052575ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8082024-08-27T23:43:38.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 545.381326ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
8092024-08-27T23:43:39.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 674.440161ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
8102024-08-27T23:43:39.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 1.403771339s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
8112024-08-27T23:43:39.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 1.064034165s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
8122024-08-27T23:43:39.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 600.552203ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8132024-08-27T23:43:39.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 673.077077ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8142024-08-27T23:43:39.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 978.29036ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
8152024-08-27T23:43:40.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 846.738721ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8162024-08-27T23:43:40.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 1.421358706s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
8172024-08-27T23:43:40.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 1.216070011s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8182024-08-27T23:43:40.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 832.407021ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
8192024-08-27T23:43:40.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 989.813059ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
8202024-08-27T23:43:40.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 537.467252ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8212024-08-27T23:43:41.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 1.317744155s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
8222024-08-27T23:43:41.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 519.44702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8232024-08-27T23:43:41.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 1.482009714s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8242024-08-27T23:43:41.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 1.2393309s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
8252024-08-27T23:43:41.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 1.466132326s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
8262024-08-27T23:43:41.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 1.402483147s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8272024-08-27T23:43:42.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 1.067493646s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
8282024-08-27T23:43:43.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 582.904761ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
8292024-08-27T23:43:43.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 1.273478916s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8302024-08-27T23:43:43.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 891.807086ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
8312024-08-27T23:43:43.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 955.981467ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8322024-08-27T23:43:43.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 1.153212649s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
8332024-08-27T23:43:43.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 1.409626585s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
8342024-08-27T23:43:44.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 1.010298671s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
8352024-08-27T23:43:44.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 1.1442035s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8362024-08-27T23:43:44.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 963.473083ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8372024-08-27T23:43:44.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 758.773961ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
8382024-08-27T23:43:45.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 1.096373469s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
8392024-08-27T23:43:45.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 880.764198ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
8402024-08-27T23:43:45.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 743.89386ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8412024-08-27T23:43:45.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 793.364477ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8422024-08-27T23:43:45.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773") failed: Property not found. retry in 1.261653398s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
8432024-08-27T23:43:46.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83") failed: Property not found. retry in 1.476010029s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
8442024-08-27T23:43:46.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 908.716395ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8452024-08-27T23:43:46.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982") failed: Property not found. retry in 518.319341ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8462024-08-27T23:43:46.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73") failed: Property not found. retry in 1.300903566s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
8472024-08-27T23:43:47.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 1.478514225s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8482024-08-27T23:43:48.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 825.311199ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8492024-08-27T23:43:49.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 1.387011944s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8502024-08-27T23:43:50.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 1.472239943s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8512024-08-27T23:43:52.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 916.07421ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8522024-08-27T23:43:52.660ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.916642221s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
8532024-08-27T23:43:53.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 616.114419ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8542024-08-27T23:43:53.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 1.481293198s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8552024-08-27T23:43:55.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 936.375419ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8562024-08-27T23:43:56.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32") failed: Property not found. retry in 954.126402ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8572024-08-27T23:43:57.320ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_cockroachdb_7bfa68fd-e941-45c7-ba90-ad8dccbdde73
8582024-08-27T23:43:57.320ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_cockroachdb_cc411e47-bdc9-403c-ae1c-616181089982
8592024-08-27T23:43:57.320ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_cockroachdb_530ea6e4-b11e-441b-a518-f6b90d2d6b32
8602024-08-27T23:43:57.320ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_cockroachdb_3bdb362e-343e-49ce-a450-de72f0e46b83
8612024-08-27T23:43:57.320ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_cockroachdb_d20d1d5e-5755-4059-be76-f4c626bbc773
8622024-08-27T23:43:57.320ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8632024-08-27T23:43:57.325ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8642024-08-27T23:43:57.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 26130780 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39772 req_id = f7a1d851-5876-444e-9bc3-728ec452512b response_code = 204 uri = /omicron-zones
8652024-08-27T23:43:57.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58916
8662024-08-27T23:43:57.405ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3681
8672024-08-27T23:43:59.287ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3699
8682024-08-27T23:44:17.387ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3722
8692024-08-27T23:44:17.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 20014246 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58916 req_id = bc0c3ea1-ec3a-42f6-af6c-9aae9308c18c response_code = 204 uri = /cockroachdb
8702024-08-27T23:44:17.387ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64405
8712024-08-27T23:44:17.448ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 39068454-e35d-4556-9935-1e87200d5f74, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 44b417dc-69af-4658-9946-22e1f17c0b4d, kind: Service { id: 39068454-e35d-4556-9935-1e87200d5f74 }, name: Name("ntp-39068454-e35d-4556-9935-1e87200d5f74"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 50])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: cc411e47-bdc9-403c-ae1c-616181089982, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External } } } }, OmicronZoneConfig { id: 530ea6e4-b11e-441b-a518-f6b90d2d6b32, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7bfa68fd-e941-45c7-ba90-ad8dccbdde73, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External } } } }, OmicronZoneConfig { id: d20d1d5e-5755-4059-be76-f4c626bbc773, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External } } } }, OmicronZoneConfig { id: 3bdb362e-343e-49ce-a450-de72f0e46b83, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9, underlay_address: fd00:1122:3344:101::8, filesystem_pool: Some(ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 0abb08aa-37a9-4359-9f08-d102aa69d873, kind: Service { id: 38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9 }, name: Name("external-dns-38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: f234ca35-e74e-4ba9-a39b-f891fe9b9788, underlay_address: fd00:1122:3344:101::9, filesystem_pool: Some(ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: e04c923d-1d17-4da7-81a5-03c4e09a42eb, kind: Service { id: f234ca35-e74e-4ba9-a39b-f891fe9b9788 }, name: Name("external-dns-f234ca35-e74e-4ba9-a39b-f891fe9b9788"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: edb0eecb-56ec-46b8-87b6-99fdeeb62e9d, underlay_address: fd00:1122:3344:101::a, filesystem_pool: Some(ZpoolName { id: b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: b7869775-ccb5-47cf-bca2-55ff9ee6115e, kind: Service { id: edb0eecb-56ec-46b8-87b6-99fdeeb62e9d }, name: Name("nexus-edb0eecb-56ec-46b8-87b6-99fdeeb62e9d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 8585144e-b855-4b7b-ae74-8c995cbc658b, underlay_address: fd00:1122:3344:101::b, filesystem_pool: Some(ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 03953ab4-5e4b-4217-a282-77728d3289c1, kind: Service { id: 8585144e-b855-4b7b-ae74-8c995cbc658b }, name: Name("nexus-8585144e-b855-4b7b-ae74-8c995cbc658b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: aee758cf-32a6-43a0-8b4b-a8989f72d531, underlay_address: fd00:1122:3344:101::c, filesystem_pool: Some(ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 3b1b015a-fe2a-493a-8a39-6eb1eca87fce, kind: Service { id: aee758cf-32a6-43a0-8b4b-a8989f72d531 }, name: Name("nexus-aee758cf-32a6-43a0-8b4b-a8989f72d531"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 7ed72eb4-42e0-4d10-b093-c71e8473de93, underlay_address: fd00:1122:3344:101::d, filesystem_pool: Some(ZpoolName { id: 58f2cdae-319b-489c-89a1-9d6a173f3e8a (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 8fbbbc9e-4d72-48cd-9e9b-d932233b9601, underlay_address: fd00:1122:3344:101::e, filesystem_pool: Some(ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External } } } }, OmicronZoneConfig { id: 01cb125d-c009-4eea-926c-a57bc6016b18, underlay_address: fd00:1122:3344:101::f, filesystem_pool: Some(ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: dde5863f-c1a0-4c31-90dd-e598d61ee6d8, underlay_address: fd00:1122:3344:101::10, filesystem_pool: Some(ZpoolName { id: 6d2d4b30-dc11-496b-9bd8-e427a70cc372 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: b7d372bc-a332-4f8c-8b98-54356aad25c6, underlay_address: fd00:1122:3344:101::11, filesystem_pool: Some(ZpoolName { id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: d0875a27-35ae-43d6-9e81-d54ffb75d34e, underlay_address: fd00:1122:3344:101::12, filesystem_pool: Some(ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External } } } }, OmicronZoneConfig { id: bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f, underlay_address: fd00:1122:3344:101::13, filesystem_pool: Some(ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External } } } }, OmicronZoneConfig { id: 76b4b5ef-028a-46ca-b29d-aa1125610c6c, underlay_address: fd00:1122:3344:101::14, filesystem_pool: Some(ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External } } } }, OmicronZoneConfig { id: 155b5740-2bb0-4534-a32a-e20de299331a, underlay_address: fd00:1122:3344:101::15, filesystem_pool: Some(ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External } } } }, OmicronZoneConfig { id: afa6d90a-4024-4ad5-aea8-184158db9ad4, underlay_address: fd00:1122:3344:101::16, filesystem_pool: Some(ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 364283e8-5bf3-410c-b0e3-f83e695b416e, underlay_address: fd00:1122:3344:101::17, filesystem_pool: Some(ZpoolName { id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool), kind: External } } } }, OmicronZoneConfig { id: eca66c7b-c7a1-46b9-9488-202951971be9, underlay_address: fd00:1122:3344:101::18, filesystem_pool: Some(ZpoolName { id: b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8ff3bb0a-4a85-43ba-917e-9049c3c9d440, underlay_address: fd00:1122:3344:101::19, filesystem_pool: Some(ZpoolName { id: 58f2cdae-319b-489c-89a1-9d6a173f3e8a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 58f2cdae-319b-489c-89a1-9d6a173f3e8a (zpool), kind: External } } } }, OmicronZoneConfig { id: 51db60c7-2141-49a8-838f-91d960e221ce, underlay_address: fd00:1122:3344:101::1a, filesystem_pool: Some(ZpoolName { id: 6d2d4b30-dc11-496b-9bd8-e427a70cc372 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6d2d4b30-dc11-496b-9bd8-e427a70cc372 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
8722024-08-27T23:44:17.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57467
8732024-08-27T23:44:17.449ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8742024-08-27T23:44:17.449ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 7b11310a-3cc7-43bf-ac4f-db028dcd8a34, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: InternalDns }, responder: ... }
8752024-08-27T23:44:17.473ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8762024-08-27T23:44:17.473ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 7d7c6d61-8eaf-4143-bf91-a51873d614ff, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8772024-08-27T23:44:17.494ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8782024-08-27T23:44:17.494ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 8cdf4291-7757-408c-bbb0-c3c5eefecf10, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: InternalDns }, responder: ... }
8792024-08-27T23:44:17.514ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cc411e47-bdc9-403c-ae1c-616181089982, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
8802024-08-27T23:44:17.515ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: cc411e47-bdc9-403c-ae1c-616181089982, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8812024-08-27T23:44:17.534ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 530ea6e4-b11e-441b-a518-f6b90d2d6b32, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
8822024-08-27T23:44:17.534ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 530ea6e4-b11e-441b-a518-f6b90d2d6b32, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8832024-08-27T23:44:17.553ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7bfa68fd-e941-45c7-ba90-ad8dccbdde73, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
8842024-08-27T23:44:17.553ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 7bfa68fd-e941-45c7-ba90-ad8dccbdde73, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8852024-08-27T23:44:17.572ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d20d1d5e-5755-4059-be76-f4c626bbc773, dataset_name: DatasetName { pool_name: ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
8862024-08-27T23:44:17.572ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: d20d1d5e-5755-4059-be76-f4c626bbc773, dataset_name: DatasetName { pool_name: ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8872024-08-27T23:44:17.592ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3bdb362e-343e-49ce-a450-de72f0e46b83, dataset_name: DatasetName { pool_name: ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
8882024-08-27T23:44:17.592ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 3bdb362e-343e-49ce-a450-de72f0e46b83, dataset_name: DatasetName { pool_name: ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8892024-08-27T23:44:17.613ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8902024-08-27T23:44:17.613ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8912024-08-27T23:44:17.740ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f234ca35-e74e-4ba9-a39b-f891fe9b9788, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8922024-08-27T23:44:17.740ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: f234ca35-e74e-4ba9-a39b-f891fe9b9788, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8932024-08-27T23:44:17.870ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8fbbbc9e-4d72-48cd-9e9b-d932233b9601, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:406
8942024-08-27T23:44:17.870ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 8fbbbc9e-4d72-48cd-9e9b-d932233b9601, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: Clickhouse }, responder: ... }
8952024-08-27T23:44:17.972ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d0875a27-35ae-43d6-9e81-d54ffb75d34e, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
8962024-08-27T23:44:17.972ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: d0875a27-35ae-43d6-9e81-d54ffb75d34e, dataset_name: DatasetName { pool_name: ZpoolName { id: 261199e3-73de-407f-8de5-043cbf4ed10d (zpool), kind: External }, kind: Crucible }, responder: ... }
8972024-08-27T23:44:18.105ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
8982024-08-27T23:44:18.105ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f, dataset_name: DatasetName { pool_name: ZpoolName { id: f5032ea4-6112-4732-b8ee-8f60011c0e16 (zpool), kind: External }, kind: Crucible }, responder: ... }
8992024-08-27T23:44:18.193ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 76b4b5ef-028a-46ca-b29d-aa1125610c6c, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9002024-08-27T23:44:18.193ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 76b4b5ef-028a-46ca-b29d-aa1125610c6c, dataset_name: DatasetName { pool_name: ZpoolName { id: 2f03970d-8389-493d-b912-73626b8d538f (zpool), kind: External }, kind: Crucible }, responder: ... }
9012024-08-27T23:44:18.370ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 155b5740-2bb0-4534-a32a-e20de299331a, dataset_name: DatasetName { pool_name: ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9022024-08-27T23:44:18.370ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 155b5740-2bb0-4534-a32a-e20de299331a, dataset_name: DatasetName { pool_name: ZpoolName { id: 01024d79-0997-4738-a4d3-daf5c97d6e9d (zpool), kind: External }, kind: Crucible }, responder: ... }
9032024-08-27T23:44:18.525ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: afa6d90a-4024-4ad5-aea8-184158db9ad4, dataset_name: DatasetName { pool_name: ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9042024-08-27T23:44:18.525ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: afa6d90a-4024-4ad5-aea8-184158db9ad4, dataset_name: DatasetName { pool_name: ZpoolName { id: 2440f700-b74a-4ef3-85b8-62d810b4ecb0 (zpool), kind: External }, kind: Crucible }, responder: ... }
9052024-08-27T23:44:18.652ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 364283e8-5bf3-410c-b0e3-f83e695b416e, dataset_name: DatasetName { pool_name: ZpoolName { id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9062024-08-27T23:44:18.652ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 364283e8-5bf3-410c-b0e3-f83e695b416e, dataset_name: DatasetName { pool_name: ZpoolName { id: 1df19093-a749-4394-9c32-b41d22eaa752 (zpool), kind: External }, kind: Crucible }, responder: ... }
9072024-08-27T23:44:18.754ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eca66c7b-c7a1-46b9-9488-202951971be9, dataset_name: DatasetName { pool_name: ZpoolName { id: b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9082024-08-27T23:44:18.754ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: eca66c7b-c7a1-46b9-9488-202951971be9, dataset_name: DatasetName { pool_name: ZpoolName { id: b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5 (zpool), kind: External }, kind: Crucible }, responder: ... }
9092024-08-27T23:44:18.868ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8ff3bb0a-4a85-43ba-917e-9049c3c9d440, dataset_name: DatasetName { pool_name: ZpoolName { id: 58f2cdae-319b-489c-89a1-9d6a173f3e8a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9102024-08-27T23:44:18.868ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 8ff3bb0a-4a85-43ba-917e-9049c3c9d440, dataset_name: DatasetName { pool_name: ZpoolName { id: 58f2cdae-319b-489c-89a1-9d6a173f3e8a (zpool), kind: External }, kind: Crucible }, responder: ... }
9112024-08-27T23:44:18.989ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 51db60c7-2141-49a8-838f-91d960e221ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 6d2d4b30-dc11-496b-9bd8-e427a70cc372 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9122024-08-27T23:44:18.989ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 51db60c7-2141-49a8-838f-91d960e221ce, dataset_name: DatasetName { pool_name: ZpoolName { id: 6d2d4b30-dc11-496b-9bd8-e427a70cc372 (zpool), kind: External }, kind: Crucible }, responder: ... }
9132024-08-27T23:44:19.101ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9142024-08-27T23:44:19.101ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/omicron-zones.json file = common/src/ledger.rs:177
9152024-08-27T23:44:19.101ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/omicron-zones.json file = common/src/ledger.rs:177
9162024-08-27T23:44:19.101ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9172024-08-27T23:44:19.236ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9182024-08-27T23:44:19.267ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9192024-08-27T23:44:19.268ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9202024-08-27T23:44:19.268ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9212024-08-27T23:44:19.268ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9222024-08-27T23:44:19.268ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9232024-08-27T23:44:19.281ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9242024-08-27T23:44:19.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9252024-08-27T23:44:19.293ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9262024-08-27T23:44:19.307ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9272024-08-27T23:44:19.506ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9282024-08-27T23:44:19.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9292024-08-27T23:44:19.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9302024-08-27T23:44:19.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9312024-08-27T23:44:19.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9322024-08-27T23:44:19.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9332024-08-27T23:44:19.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9342024-08-27T23:44:19.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9352024-08-27T23:44:19.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9362024-08-27T23:44:19.507ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93 file = illumos-utils/src/zone.rs:316
9372024-08-27T23:44:19.513ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18 file = illumos-utils/src/zone.rs:316
9382024-08-27T23:44:19.518ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c file = illumos-utils/src/zone.rs:316
9392024-08-27T23:44:19.523ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a file = illumos-utils/src/zone.rs:316
9402024-08-27T23:44:19.528ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4 file = illumos-utils/src/zone.rs:316
9412024-08-27T23:44:19.533ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601 file = illumos-utils/src/zone.rs:316
9422024-08-27T23:44:19.728ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9432024-08-27T23:44:19.728ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93 file = illumos-utils/src/zone.rs:354
9442024-08-27T23:44:19.733ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18 file = illumos-utils/src/zone.rs:354
9452024-08-27T23:44:19.738ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c file = illumos-utils/src/zone.rs:354
9462024-08-27T23:44:19.742ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a file = illumos-utils/src/zone.rs:354
9472024-08-27T23:44:19.747ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4 file = illumos-utils/src/zone.rs:354
9482024-08-27T23:44:19.752ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601 file = illumos-utils/src/zone.rs:354
9492024-08-27T23:44:19.756ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6 file = illumos-utils/src/zone.rs:316
9502024-08-27T23:44:19.761ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e file = illumos-utils/src/zone.rs:316
9512024-08-27T23:44:19.766ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8 file = illumos-utils/src/zone.rs:316
9522024-08-27T23:44:19.772ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9 file = illumos-utils/src/zone.rs:316
9532024-08-27T23:44:19.778ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f file = illumos-utils/src/zone.rs:316
9542024-08-27T23:44:19.784ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440 file = illumos-utils/src/zone.rs:316
9552024-08-27T23:44:19.790ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce file = illumos-utils/src/zone.rs:316
9562024-08-27T23:44:19.796ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e file = illumos-utils/src/zone.rs:316
9572024-08-27T23:44:19.836ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9582024-08-27T23:44:19.870ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9592024-08-27T23:44:19.871ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6 file = illumos-utils/src/zone.rs:354
9602024-08-27T23:44:19.876ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e file = illumos-utils/src/zone.rs:354
9612024-08-27T23:44:19.880ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8 file = illumos-utils/src/zone.rs:354
9622024-08-27T23:44:19.884ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9 file = illumos-utils/src/zone.rs:354
9632024-08-27T23:44:19.888ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f file = illumos-utils/src/zone.rs:354
9642024-08-27T23:44:19.893ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440 file = illumos-utils/src/zone.rs:354
9652024-08-27T23:44:19.898ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce file = illumos-utils/src/zone.rs:354
9662024-08-27T23:44:19.903ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e file = illumos-utils/src/zone.rs:354
9672024-08-27T23:44:19.913ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9682024-08-27T23:44:19.913ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9692024-08-27T23:44:19.956ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 157, 195]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
9702024-08-27T23:44:19.956ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = external_dns
9712024-08-27T23:44:20.021ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9722024-08-27T23:44:20.074ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9732024-08-27T23:44:20.077ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9742024-08-27T23:44:20.077ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9752024-08-27T23:44:20.127ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 154, 235]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9762024-08-27T23:44:20.127ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = nexus
9772024-08-27T23:44:20.129ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9782024-08-27T23:44:20.129ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9792024-08-27T23:44:20.179ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 148, 0]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
9802024-08-27T23:44:20.179ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = external_dns
9812024-08-27T23:44:20.180ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
9822024-08-27T23:44:20.180ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
9832024-08-27T23:44:20.182ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9842024-08-27T23:44:20.182ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9852024-08-27T23:44:20.229ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 142, 126]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9862024-08-27T23:44:20.229ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = nexus
9872024-08-27T23:44:20.230ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
9882024-08-27T23:44:20.230ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
9892024-08-27T23:44:20.230ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
9902024-08-27T23:44:20.230ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
9912024-08-27T23:44:20.231ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9922024-08-27T23:44:20.231ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9932024-08-27T23:44:20.291ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 165, 220]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9942024-08-27T23:44:20.291ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = nexus
9952024-08-27T23:44:20.292ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
9962024-08-27T23:44:20.294ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
9972024-08-27T23:44:20.294ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9982024-08-27T23:44:20.296ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
9992024-08-27T23:44:20.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
10002024-08-27T23:44:20.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
10012024-08-27T23:44:20.518ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788 file = illumos-utils/src/zone.rs:316
10022024-08-27T23:44:20.525ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
10032024-08-27T23:44:20.526ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
10042024-08-27T23:44:20.526ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b file = illumos-utils/src/zone.rs:316
10052024-08-27T23:44:20.534ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
10062024-08-27T23:44:20.534ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
10072024-08-27T23:44:20.535ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
10082024-08-27T23:44:20.538ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
10092024-08-27T23:44:20.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
10102024-08-27T23:44:20.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
10112024-08-27T23:44:20.570ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b file = illumos-utils/src/zone.rs:354
10122024-08-27T23:44:20.576ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9 file = illumos-utils/src/zone.rs:316
10132024-08-27T23:44:20.612ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788 file = illumos-utils/src/zone.rs:354
10142024-08-27T23:44:20.619ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531 file = illumos-utils/src/zone.rs:316
10152024-08-27T23:44:20.626ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9 file = illumos-utils/src/zone.rs:354
10162024-08-27T23:44:20.634ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d file = illumos-utils/src/zone.rs:316
10172024-08-27T23:44:20.650ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531 file = illumos-utils/src/zone.rs:354
10182024-08-27T23:44:20.667ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d file = illumos-utils/src/zone.rs:354
10192024-08-27T23:44:21.695ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10202024-08-27T23:44:21.696ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
10212024-08-27T23:44:21.756ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2f03970d-8389-493d-b912-73626b8d538f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d83a24a3-8fdd-4977-91b7-d0f24c51a44e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10222024-08-27T23:44:21.756ZINFOSledAgent (ServiceManager): Booting oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
10232024-08-27T23:44:21.763ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_01024d79-0997-4738-a4d3-daf5c97d6e9d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='94677764-2fcd-44b5-aee9-84b505d7d949'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10242024-08-27T23:44:21.764ZINFOSledAgent (ServiceManager): Booting oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
10252024-08-27T23:44:21.794ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2440f700-b74a-4ef3-85b8-62d810b4ecb0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='01aacf45-c024-4aa1-b57a-519e4c81ccff'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10262024-08-27T23:44:21.794ZINFOSledAgent (ServiceManager): Booting oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
10272024-08-27T23:44:21.801ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='7ed72eb4-42e0-4d10-b093-c71e8473de93'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10282024-08-27T23:44:21.801ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
10292024-08-27T23:44:22.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 29.243837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
10302024-08-27T23:44:22.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 29.599849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
10312024-08-27T23:44:22.353ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10322024-08-27T23:44:22.353ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
10332024-08-27T23:44:22.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 97.866155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
10342024-08-27T23:44:22.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 132.886814ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
10352024-08-27T23:44:22.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 53.767242ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
10362024-08-27T23:44:22.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 37.922577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
10372024-08-27T23:44:22.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 55.501017ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
10382024-08-27T23:44:22.438ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10392024-08-27T23:44:22.438ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cf626b24-a9fc-432c-9f7f-7266fb7ef5e9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10402024-08-27T23:44:22.438ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
10412024-08-27T23:44:22.445ZINFOSledAgent (ServiceManager): Booting oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
10422024-08-27T23:44:22.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 98.794845ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
10432024-08-27T23:44:22.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 102.537198ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
10442024-08-27T23:44:22.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 286.592371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
10452024-08-27T23:44:22.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 68.586413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
10462024-08-27T23:44:22.531ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_261199e3-73de-407f-8de5-043cbf4ed10d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='74a478de-389c-4c6e-bff3-0fc10e12df71'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10472024-08-27T23:44:22.532ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
10482024-08-27T23:44:22.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 238.581038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
10492024-08-27T23:44:22.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 287.797384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
10502024-08-27T23:44:22.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 294.698499ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
10512024-08-27T23:44:22.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 104.70343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
10522024-08-27T23:44:22.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 31.934803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
10532024-08-27T23:44:23.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 73.570576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
10542024-08-27T23:44:24.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 481.210228ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
10552024-08-27T23:44:24.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 544.590126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
10562024-08-27T23:44:24.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 558.630306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
10572024-08-27T23:44:24.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 364.605811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
10582024-08-27T23:44:25.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 574.56707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
10592024-08-27T23:44:25.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 107.709579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
10602024-08-27T23:44:25.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 71.621543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
10612024-08-27T23:44:25.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 74.827079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
10622024-08-27T23:44:25.149ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f5032ea4-6112-4732-b8ee-8f60011c0e16/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8de430bf-c8b8-42d8-8b28-096ad3d88fc2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10632024-08-27T23:44:25.150ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_58f2cdae-319b-489c-89a1-9d6a173f3e8a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='94ad9297-926e-40a9-8c75-2d6aecc4a852'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10642024-08-27T23:44:25.152ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6d2d4b30-dc11-496b-9bd8-e427a70cc372/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ddf56fde-eeec-4330-8842-71d2f065e925'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10652024-08-27T23:44:25.154ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1df19093-a749-4394-9c32-b41d22eaa752/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a81c4c90-6e17-4930-89b1-5a899d5bb885'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10662024-08-27T23:44:25.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 71.6ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
10672024-08-27T23:44:25.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 283.324374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
10682024-08-27T23:44:25.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 64.419118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
10692024-08-27T23:44:25.262ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
10702024-08-27T23:44:25.273ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
10712024-08-27T23:44:25.287ZINFOSledAgent (ServiceManager): Booting oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
10722024-08-27T23:44:25.299ZINFOSledAgent (ServiceManager): Booting oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
10732024-08-27T23:44:25.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 733.714777ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
10742024-08-27T23:44:25.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 100.770449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
10752024-08-27T23:44:25.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 127.405671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
10762024-08-27T23:44:25.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 105.548065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
10772024-08-27T23:44:25.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 1.01446253s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
10782024-08-27T23:44:25.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 483.342805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
10792024-08-27T23:44:25.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 451.581123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
10802024-08-27T23:44:25.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 705.231059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
10812024-08-27T23:44:25.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 427.404253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
10822024-08-27T23:44:25.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 243.312109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
10832024-08-27T23:44:25.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 422.490451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
10842024-08-27T23:44:25.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 210.804921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
10852024-08-27T23:44:26.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 1.294367755s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
10862024-08-27T23:44:26.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 58.515979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
10872024-08-27T23:44:26.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 73.011283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
10882024-08-27T23:44:26.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 34.494323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
10892024-08-27T23:44:26.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 39.978186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
10902024-08-27T23:44:26.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 130.838317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
10912024-08-27T23:44:26.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 142.078396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
10922024-08-27T23:44:26.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 136.76086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
10932024-08-27T23:44:26.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 117.597184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
10942024-08-27T23:44:26.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 395.472188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
10952024-08-27T23:44:26.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 706.794148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
10962024-08-27T23:44:26.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 292.349302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
10972024-08-27T23:44:26.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 278.261231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
10982024-08-27T23:44:26.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 856.347152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
10992024-08-27T23:44:26.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 1.297457642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
11002024-08-27T23:44:26.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 563.165548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
11012024-08-27T23:44:26.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 697.878103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
11022024-08-27T23:44:26.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 798.818828ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
11032024-08-27T23:44:26.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 905.501669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
11042024-08-27T23:44:26.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 156.480364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
11052024-08-27T23:44:26.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 423.748842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
11062024-08-27T23:44:27.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 270.7652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
11072024-08-27T23:44:27.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 256.440857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
11082024-08-27T23:44:27.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 647.249988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
11092024-08-27T23:44:27.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 807.980517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
11102024-08-27T23:44:27.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 340.812079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
11112024-08-27T23:44:27.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 465.485756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
11122024-08-27T23:44:27.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 828.166439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
11132024-08-27T23:44:27.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 1.419348759s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
11142024-08-27T23:44:27.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 1.025789347s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
11152024-08-27T23:44:27.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 1.15751198s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
11162024-08-27T23:44:27.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 696.683361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
11172024-08-27T23:44:27.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 1.138832994s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
11182024-08-27T23:44:27.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 906.425937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
11192024-08-27T23:44:27.585ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11202024-08-27T23:44:27.585ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
11212024-08-27T23:44:27.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 1.189432133s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
11222024-08-27T23:44:27.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 1.442871953s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
11232024-08-27T23:44:27.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 1.308498039s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
11242024-08-27T23:44:27.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 921.736595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
11252024-08-27T23:44:27.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 35.720978ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
11262024-08-27T23:44:27.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 704.676507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
11272024-08-27T23:44:27.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 94.01904ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
11282024-08-27T23:44:28.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 1.233671067s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
11292024-08-27T23:44:28.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 197.205695ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
11302024-08-27T23:44:28.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 1.101758909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
11312024-08-27T23:44:28.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 1.261558762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
11322024-08-27T23:44:28.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 567.271139ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
11332024-08-27T23:44:28.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 1.303842059s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
11342024-08-27T23:44:28.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 863.444169ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
11352024-08-27T23:44:28.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 1.194349789s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
11362024-08-27T23:44:28.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 1.115512756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
11372024-08-27T23:44:28.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 1.203753044s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
11382024-08-27T23:44:28.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 1.125939331s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
11392024-08-27T23:44:28.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 567.464579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
11402024-08-27T23:44:28.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 1.137653278s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
11412024-08-27T23:44:28.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 650.970935ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
11422024-08-27T23:44:29.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 1.106321051s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
11432024-08-27T23:44:29.215ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11442024-08-27T23:44:29.216ZINFOSledAgent (ServiceManager): Booting oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
11452024-08-27T23:44:29.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 564.806755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
11462024-08-27T23:44:29.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 510.675078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
11472024-08-27T23:44:29.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 1.202770302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
11482024-08-27T23:44:29.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 771.881852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
11492024-08-27T23:44:29.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 917.609506ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
11502024-08-27T23:44:29.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 49.086266ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
11512024-08-27T23:44:29.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 518.333402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
11522024-08-27T23:44:29.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 91.581529ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
11532024-08-27T23:44:29.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 559.923568ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
11542024-08-27T23:44:29.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 287.587524ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
11552024-08-27T23:44:29.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 506.831093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
11562024-08-27T23:44:29.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 1.013562349s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
11572024-08-27T23:44:29.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 1.077362039s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
11582024-08-27T23:44:29.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 833.002086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
11592024-08-27T23:44:29.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 504.303075ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
11602024-08-27T23:44:29.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 1.066509002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
11612024-08-27T23:44:29.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 1.051315513s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
11622024-08-27T23:44:29.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 348.360149ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
11632024-08-27T23:44:30.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 797.68705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
11642024-08-27T23:44:30.066ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11652024-08-27T23:44:30.066ZINFOSledAgent (ServiceManager): Booting oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
11662024-08-27T23:44:30.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 881.413096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
11672024-08-27T23:44:30.126ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11682024-08-27T23:44:30.126ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
11692024-08-27T23:44:30.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 941.737548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
11702024-08-27T23:44:30.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 747.740641ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
11712024-08-27T23:44:30.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 1.45552384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
11722024-08-27T23:44:30.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 1.350826645s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
11732024-08-27T23:44:30.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 672.898723ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
11742024-08-27T23:44:30.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 1.362248554s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
11752024-08-27T23:44:30.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 73.689126ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
11762024-08-27T23:44:30.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 571.113278ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
11772024-08-27T23:44:30.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 131.803809ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
11782024-08-27T23:44:30.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 838.105802ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
11792024-08-27T23:44:30.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 70.011139ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
11802024-08-27T23:44:30.610ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11812024-08-27T23:44:30.610ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
11822024-08-27T23:44:30.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 245.278131ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
11832024-08-27T23:44:30.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 90.503024ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
11842024-08-27T23:44:30.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 1.157180589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
11852024-08-27T23:44:30.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 775.695847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
11862024-08-27T23:44:30.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 1.363221539s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
11872024-08-27T23:44:30.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 153.685683ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
11882024-08-27T23:44:30.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 381.096623ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
11892024-08-27T23:44:31.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 851.791259ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
11902024-08-27T23:44:31.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 1.319452651s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
11912024-08-27T23:44:31.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 51.015808ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
11922024-08-27T23:44:31.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 1.107193397s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
11932024-08-27T23:44:31.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 915.162247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
11942024-08-27T23:44:31.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 1.036416754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
11952024-08-27T23:44:31.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 128.224338ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
11962024-08-27T23:44:31.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 554.098838ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
11972024-08-27T23:44:31.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 1.461527673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
11982024-08-27T23:44:31.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 1.471653364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
11992024-08-27T23:44:31.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 1.140289594s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
12002024-08-27T23:44:31.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 128.698733ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
12012024-08-27T23:44:31.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 926.956571ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
12022024-08-27T23:44:31.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 667.425789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
12032024-08-27T23:44:31.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 292.101854ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
12042024-08-27T23:44:31.535ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="clickhouse_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12052024-08-27T23:44:31.535ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
12062024-08-27T23:44:31.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 1.27966627s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
12072024-08-27T23:44:31.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 673.994831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
12082024-08-27T23:44:31.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 61.124897ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
12092024-08-27T23:44:31.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 504.22006ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
12102024-08-27T23:44:31.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 601.76797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
12112024-08-27T23:44:31.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 890.084323ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
12122024-08-27T23:44:31.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 1.169170202s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
12132024-08-27T23:44:31.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 88.577408ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
12142024-08-27T23:44:31.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 1.361036049s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
12152024-08-27T23:44:31.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 167.29945ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
12162024-08-27T23:44:31.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 910.829803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
12172024-08-27T23:44:32.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 1.225117735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
12182024-08-27T23:44:32.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 1.389947469s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
12192024-08-27T23:44:32.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 536.297147ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
12202024-08-27T23:44:32.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 1.3982284s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
12212024-08-27T23:44:32.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 1.356351922s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
12222024-08-27T23:44:32.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 1.053023153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
12232024-08-27T23:44:32.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 1.25797757s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
12242024-08-27T23:44:32.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 1.403534042s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
12252024-08-27T23:44:32.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 1.188111748s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
12262024-08-27T23:44:32.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 1.263343446s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
12272024-08-27T23:44:32.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 772.848209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
12282024-08-27T23:44:32.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 978.022496ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
12292024-08-27T23:44:32.456ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.503818021s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
12302024-08-27T23:44:32.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 1.021871894s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
12312024-08-27T23:44:32.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 633.225553ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
12322024-08-27T23:44:32.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 992.441263ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
12332024-08-27T23:44:32.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 817.889389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
12342024-08-27T23:44:32.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 1.38830915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
12352024-08-27T23:44:32.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 1.329514601s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
12362024-08-27T23:44:33.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 1.320115058s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
12372024-08-27T23:44:33.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 766.197913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
12382024-08-27T23:44:33.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 1.151622258s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
12392024-08-27T23:44:33.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 990.093477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
12402024-08-27T23:44:33.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 1.231187334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
12412024-08-27T23:44:33.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 1.185148079s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
12422024-08-27T23:44:33.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 525.469446ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
12432024-08-27T23:44:33.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 1.324526225s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
12442024-08-27T23:44:33.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 1.288621025s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
12452024-08-27T23:44:33.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 1.397078396s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
12462024-08-27T23:44:33.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 595.759042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
12472024-08-27T23:44:33.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 584.412397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
12482024-08-27T23:44:33.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 806.223874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
12492024-08-27T23:44:33.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 1.117582595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
12502024-08-27T23:44:33.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 870.038883ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
12512024-08-27T23:44:33.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 1.174177519s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
12522024-08-27T23:44:33.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 700.387145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
12532024-08-27T23:44:33.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 929.958051ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
12542024-08-27T23:44:33.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8") failed: Property not found. retry in 1.392785072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
12552024-08-27T23:44:34.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 1.249745608s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
12562024-08-27T23:44:34.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4") failed: Property not found. retry in 1.486704998s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
12572024-08-27T23:44:34.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 853.790411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
12582024-08-27T23:44:34.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 1.174697202s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
12592024-08-27T23:44:34.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 660.167478ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
12602024-08-27T23:44:34.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 711.101064ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
12612024-08-27T23:44:34.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18") failed: Property not found. retry in 1.439932363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
12622024-08-27T23:44:34.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 914.404742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
12632024-08-27T23:44:34.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 986.687542ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
12642024-08-27T23:44:34.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 1.103221202s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
12652024-08-27T23:44:34.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 797.661935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
12662024-08-27T23:44:34.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 729.057157ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
12672024-08-27T23:44:34.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6") failed: Property not found. retry in 879.043874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
12682024-08-27T23:44:34.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 1.215785044s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
12692024-08-27T23:44:34.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 965.205547ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
12702024-08-27T23:44:34.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 1.443234777s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
12712024-08-27T23:44:34.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 535.197558ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
12722024-08-27T23:44:35.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93") failed: Property not found. retry in 1.40818941s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
12732024-08-27T23:44:35.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a") failed: Property not found. retry in 701.83263ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
12742024-08-27T23:44:35.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 526.085353ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
12752024-08-27T23:44:35.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 1.095541692s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
12762024-08-27T23:44:35.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 884.805669ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
12772024-08-27T23:44:35.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9") failed: Property not found. retry in 1.310821071s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
12782024-08-27T23:44:35.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 1.156602041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
12792024-08-27T23:44:35.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 506.1362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
12802024-08-27T23:44:35.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 971.960136ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
12812024-08-27T23:44:35.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 696.082625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
12822024-08-27T23:44:35.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 844.399421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
12832024-08-27T23:44:35.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 1.194573499s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
12842024-08-27T23:44:35.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 969.498306ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
12852024-08-27T23:44:35.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 971.931957ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
12862024-08-27T23:44:36.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 637.563818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
12872024-08-27T23:44:36.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 555.272263ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
12882024-08-27T23:44:36.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 1.081499375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
12892024-08-27T23:44:36.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 1.006405582s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
12902024-08-27T23:44:36.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 1.278218892s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
12912024-08-27T23:44:36.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 914.622883ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
12922024-08-27T23:44:36.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c") failed: Property not found. retry in 542.202153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
12932024-08-27T23:44:36.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 1.050264362s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
12942024-08-27T23:44:36.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 737.923393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
12952024-08-27T23:44:36.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f") failed: Property not found. retry in 1.333718434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
12962024-08-27T23:44:36.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 1.215020342s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
12972024-08-27T23:44:36.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 539.488299ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
12982024-08-27T23:44:36.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 1.128886338s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
12992024-08-27T23:44:36.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788") failed: Property not found. retry in 1.230978928s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
13002024-08-27T23:44:37.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 703.072709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
13012024-08-27T23:44:37.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 1.070915718s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
13022024-08-27T23:44:37.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 789.393285ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
13032024-08-27T23:44:37.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 1.429333495s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
13042024-08-27T23:44:37.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e") failed: Property not found. retry in 1.449809654s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
13052024-08-27T23:44:37.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 1.107166899s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
13062024-08-27T23:44:37.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 770.017219ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
13072024-08-27T23:44:37.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 688.300873ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
13082024-08-27T23:44:38.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 1.146605962s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
13092024-08-27T23:44:38.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 1.441302399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
13102024-08-27T23:44:38.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 517.489278ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
13112024-08-27T23:44:38.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 879.352044ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
13122024-08-27T23:44:38.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 1.352646213s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
13132024-08-27T23:44:38.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 1.330983664s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
13142024-08-27T23:44:38.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 745.757608ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
13152024-08-27T23:44:38.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 1.232607011s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
13162024-08-27T23:44:38.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440") failed: Property not found. retry in 784.060477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
13172024-08-27T23:44:39.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 1.272703931s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
13182024-08-27T23:44:39.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 1.425716658s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
13192024-08-27T23:44:39.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 1.126865927s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
13202024-08-27T23:44:39.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce") failed: Property not found. retry in 1.207780904s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
13212024-08-27T23:44:39.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 840.816468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
13222024-08-27T23:44:39.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 668.254287ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
13232024-08-27T23:44:39.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 1.182186515s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
13242024-08-27T23:44:40.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 547.662459ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
13252024-08-27T23:44:40.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d") failed: Property not found. retry in 1.297960847s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
13262024-08-27T23:44:40.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e") failed: Property not found. retry in 654.380231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
13272024-08-27T23:44:40.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 592.372089ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
13282024-08-27T23:44:40.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 1.221549327s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
13292024-08-27T23:44:41.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b") failed: Property not found. retry in 615.547384ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
13302024-08-27T23:44:41.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9") failed: Property not found. retry in 1.06606706s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
13312024-08-27T23:44:41.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531") failed: Property not found. retry in 815.825372ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
13322024-08-27T23:44:41.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601") failed: Property not found. retry in 1.384710255s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
13332024-08-27T23:44:42.000ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 19.992171182s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13342024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_external_dns_f234ca35-e74e-4ba9-a39b-f891fe9b9788
13352024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_oximeter_7ed72eb4-42e0-4d10-b093-c71e8473de93
13362024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_pantry_01cb125d-c009-4eea-926c-a57bc6016b18
13372024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_76b4b5ef-028a-46ca-b29d-aa1125610c6c
13382024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_155b5740-2bb0-4534-a32a-e20de299331a
13392024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_nexus_aee758cf-32a6-43a0-8b4b-a8989f72d531
13402024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_afa6d90a-4024-4ad5-aea8-184158db9ad4
13412024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_nexus_8585144e-b855-4b7b-ae74-8c995cbc658b
13422024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_external_dns_38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9
13432024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_clickhouse_8fbbbc9e-4d72-48cd-9e9b-d932233b9601
13442024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_pantry_b7d372bc-a332-4f8c-8b98-54356aad25c6
13452024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_d0875a27-35ae-43d6-9e81-d54ffb75d34e
13462024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_pantry_dde5863f-c1a0-4c31-90dd-e598d61ee6d8
13472024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_eca66c7b-c7a1-46b9-9488-202951971be9
13482024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_bcfd4480-8cdf-43ba-9cd5-30f75ccd6c3f
13492024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_8ff3bb0a-4a85-43ba-917e-9049c3c9d440
13502024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_51db60c7-2141-49a8-838f-91d960e221ce
13512024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_364283e8-5bf3-410c-b0e3-f83e695b416e
13522024-08-27T23:44:43.334ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_nexus_edb0eecb-56ec-46b8-87b6-99fdeeb62e9d
13532024-08-27T23:44:43.335ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
13542024-08-27T23:44:43.340ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
13552024-08-27T23:44:43.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 25897609 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57467 req_id = e2ae2386-5221-41ac-87e6-c40a6726253d response_code = 204 uri = /omicron-zones
13562024-08-27T23:44:43.359ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1286
13572024-08-27T23:44:43.359ZINFOSledAgent (RSS): Writing ledger to /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
13582024-08-27T23:44:43.359ZINFOSledAgent (RSS): Writing ledger to /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
13592024-08-27T23:44:43.362ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:687
13602024-08-27T23:44:43.363ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:700
13612024-08-27T23:44:43.407ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), local_pref: None, nexthop: 10.151.2.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:867
13622024-08-27T23:44:43.408ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13632024-08-27T23:44:43.463ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13642024-08-27T23:44:43.598ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13652024-08-27T23:44:43.688ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54500
13662024-08-27T23:44:43.690ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1013 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54500 req_id = 07e1b28e-906d-4d1e-985f-5579f1fa79b9 response_code = 200 uri = /baseboard
13672024-08-27T23:44:43.701ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13682024-08-27T23:44:43.870ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13692024-08-27T23:44:44.006ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13702024-08-27T23:44:44.310ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13712024-08-27T23:44:44.477ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13722024-08-27T23:44:44.837ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13732024-08-27T23:44:45.141ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13742024-08-27T23:44:45.662ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13752024-08-27T23:44:46.452ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13762024-08-27T23:44:47.070ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13772024-08-27T23:44:48.234ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13782024-08-27T23:44:48.520ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13792024-08-27T23:44:49.030ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13802024-08-27T23:44:49.357ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13812024-08-27T23:44:49.419ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13822024-08-27T23:44:50.033ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13832024-08-27T23:44:51.036ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13842024-08-27T23:44:51.213ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13852024-08-27T23:44:51.420ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13862024-08-27T23:44:52.040ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13872024-08-27T23:44:53.044ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13882024-08-27T23:44:53.271ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13892024-08-27T23:44:53.418ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13902024-08-27T23:44:54.048ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13912024-08-27T23:44:54.482ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13922024-08-27T23:44:55.052ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13932024-08-27T23:44:55.419ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13942024-08-27T23:44:56.055ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13952024-08-27T23:44:56.291ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
13962024-08-27T23:44:57.057ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13972024-08-27T23:44:57.418ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13982024-08-27T23:44:58.062ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
13992024-08-27T23:44:58.755ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14002024-08-27T23:44:59.066ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14012024-08-27T23:44:59.418ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14022024-08-27T23:45:00.069ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14032024-08-27T23:45:01.078ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14042024-08-27T23:45:01.418ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14052024-08-27T23:45:01.601ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14062024-08-27T23:45:02.051ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 25.018842017s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14072024-08-27T23:45:02.081ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14082024-08-27T23:45:03.085ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14092024-08-27T23:45:03.420ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14102024-08-27T23:45:04.089ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14112024-08-27T23:45:04.965ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/b789fdaa-dfa9-4b88-b1cf-1807a37e31b9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14122024-08-27T23:45:05.092ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b2ce5e72-9d59-4cfb-87ef-79f549e07564): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14132024-08-27T23:45:07.595ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:544 new_generation = 1 old_generation = 1 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
14142024-08-27T23:45:11.830ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b3115248-ac50-4401-8b31-2cb1bcab7ef5", "content-length": "173", "date": "Tue, 27 Aug 2024 23:45:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b789fdaa-dfa9-4b88-b1cf-1807a37e31b9\"", request_id: "b3115248-ac50-4401-8b31-2cb1bcab7ef5" } file = sled-agent/src/rack_setup/service.rs:929
14152024-08-27T23:45:12.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62826
14162024-08-27T23:45:12.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62826 req_id = 0668f7d6-cae8-4580-8998-14245d8ad262 response_code = 200 uri = /vpc-routes
14172024-08-27T23:45:12.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62826 req_id = 81ef5726-7248-4f86-8a11-6a6b16427159 response_code = 204 uri = /vpc-routes
14182024-08-27T23:45:12.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36737
14192024-08-27T23:45:12.996ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14202024-08-27T23:45:13.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95981 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36737 req_id = 23037beb-8388-49d4-b5b2-9aa1f60de535 response_code = 200 uri = /inventory
14212024-08-27T23:45:13.091ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14222024-08-27T23:45:13.091ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/omicron-zones.json file = common/src/ledger.rs:177
14232024-08-27T23:45:13.093ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/omicron-zones.json file = common/src/ledger.rs:177
14242024-08-27T23:45:13.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36737 req_id = 75817e41-2ba0-40c3-b238-46ee19528744 response_code = 200 uri = /omicron-zones
14252024-08-27T23:45:13.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43502
14262024-08-27T23:45:13.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43502 req_id = 5755fa17-9dd6-4e6f-ab41-5be535163fca response_code = 200 uri = /v2p
14272024-08-27T23:45:13.725ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54469
14282024-08-27T23:45:13.725ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54469 req_id = 5457b02c-60d9-48db-9500-e78b01eab3c9 response_code = 200 uri = /baseboard
14292024-08-27T23:45:14.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63680
14302024-08-27T23:45:14.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14312024-08-27T23:45:14.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 120326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63680 req_id = 45f95f6f-e355-4d46-b8ae-31a8558882a7 response_code = 200 uri = /inventory
14322024-08-27T23:45:14.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35702
14332024-08-27T23:45:14.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35702 req_id = 8305be1f-416d-4167-b5b1-ed0f70732bca response_code = 200 uri = /vpc-routes
14342024-08-27T23:45:14.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14352024-08-27T23:45:14.230ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/omicron-zones.json file = common/src/ledger.rs:177
14362024-08-27T23:45:14.230ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/omicron-zones.json file = common/src/ledger.rs:177
14372024-08-27T23:45:14.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 722 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63680 req_id = 58ef9d12-c0ee-42ac-98e4-99fcec0c9d6a response_code = 200 uri = /omicron-zones
14382024-08-27T23:45:14.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51563
14392024-08-27T23:45:14.235ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14402024-08-27T23:45:14.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 114911 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51563 req_id = 1254881a-fc6c-4aa6-8c7a-a91a37f63493 response_code = 200 uri = /inventory
14412024-08-27T23:45:14.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56137
14422024-08-27T23:45:14.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45377
14432024-08-27T23:45:14.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 903 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56137 req_id = 0e8e9882-ed8a-4509-90fe-46042fc77843 response_code = 200 uri = /vpc-routes
14442024-08-27T23:45:14.351ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14452024-08-27T23:45:14.351ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/omicron-zones.json file = common/src/ledger.rs:177
14462024-08-27T23:45:14.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45377 req_id = 2909be38-7286-4406-a82c-a80d11f47dfe response_code = 200 uri = /v2p
14472024-08-27T23:45:14.351ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/omicron-zones.json file = common/src/ledger.rs:177
14482024-08-27T23:45:14.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1768 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51563 req_id = 2bb1e590-8e7e-40d5-88ab-d2bbf2bd59f7 response_code = 200 uri = /omicron-zones
14492024-08-27T23:45:14.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33820
14502024-08-27T23:45:14.379ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14512024-08-27T23:45:14.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33820 req_id = 78e6f94f-20e3-40d4-be5c-936dc12d82f0 response_code = 200 uri = /inventory
14522024-08-27T23:45:14.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50750
14532024-08-27T23:45:14.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50750 req_id = 9dfc9296-a2dc-4924-8ac9-1f80bef8a44f response_code = 200 uri = /v2p
14542024-08-27T23:45:14.493ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14552024-08-27T23:45:14.493ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/omicron-zones.json file = common/src/ledger.rs:177
14562024-08-27T23:45:14.493ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/omicron-zones.json file = common/src/ledger.rs:177
14572024-08-27T23:45:14.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6052 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33820 req_id = 90cf1391-6bf1-4840-8066-7fd99cf1c87a response_code = 200 uri = /omicron-zones
14582024-08-27T23:45:14.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35702 req_id = e2de9760-7bfc-4edd-a6cb-03fee45afaf5 response_code = 204 uri = /vpc-routes
14592024-08-27T23:45:14.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 866 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56137 req_id = 62472d52-0c5d-4b4b-b676-949fab61325b response_code = 204 uri = /vpc-routes
14602024-08-27T23:45:22.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55532
14612024-08-27T23:45:22.667ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0abb08aa-37a9-4359-9f08-d102aa69d873, kind: Service { id: 38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9 }, name: Name("external-dns-38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e04c923d-1d17-4da7-81a5-03c4e09a42eb, kind: Service { id: f234ca35-e74e-4ba9-a39b-f891fe9b9788 }, name: Name("external-dns-f234ca35-e74e-4ba9-a39b-f891fe9b9788"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03953ab4-5e4b-4217-a282-77728d3289c1, kind: Service { id: 8585144e-b855-4b7b-ae74-8c995cbc658b }, name: Name("nexus-8585144e-b855-4b7b-ae74-8c995cbc658b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b1b015a-fe2a-493a-8a39-6eb1eca87fce, kind: Service { id: aee758cf-32a6-43a0-8b4b-a8989f72d531 }, name: Name("nexus-aee758cf-32a6-43a0-8b4b-a8989f72d531"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7869775-ccb5-47cf-bca2-55ff9ee6115e, kind: Service { id: edb0eecb-56ec-46b8-87b6-99fdeeb62e9d }, name: Name("nexus-edb0eecb-56ec-46b8-87b6-99fdeeb62e9d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14622024-08-27T23:45:22.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14632024-08-27T23:45:22.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14642024-08-27T23:45:22.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14652024-08-27T23:45:22.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
14662024-08-27T23:45:22.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14672024-08-27T23:45:22.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14682024-08-27T23:45:22.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4990 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55532 req_id = 81175f11-9a37-4c6e-9422-5a2f64b4c4bb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14692024-08-27T23:45:22.670ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:939
14702024-08-27T23:45:23.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41395
14712024-08-27T23:45:23.103ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14722024-08-27T23:45:23.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93431 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41395 req_id = 93afbbaf-bdc0-487c-9739-ba8cc3d8311d response_code = 200 uri = /inventory
14732024-08-27T23:45:23.198ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14742024-08-27T23:45:23.198ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/config/omicron-zones.json file = common/src/ledger.rs:177
14752024-08-27T23:45:23.198ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/config/omicron-zones.json file = common/src/ledger.rs:177
14762024-08-27T23:45:23.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1533 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41395 req_id = f10590d0-bb50-4492-bd55-1b067adcab28 response_code = 200 uri = /omicron-zones
14772024-08-27T23:45:24.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53574
14782024-08-27T23:45:24.320ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0abb08aa-37a9-4359-9f08-d102aa69d873, kind: Service { id: 38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9 }, name: Name("external-dns-38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e04c923d-1d17-4da7-81a5-03c4e09a42eb, kind: Service { id: f234ca35-e74e-4ba9-a39b-f891fe9b9788 }, name: Name("external-dns-f234ca35-e74e-4ba9-a39b-f891fe9b9788"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03953ab4-5e4b-4217-a282-77728d3289c1, kind: Service { id: 8585144e-b855-4b7b-ae74-8c995cbc658b }, name: Name("nexus-8585144e-b855-4b7b-ae74-8c995cbc658b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b1b015a-fe2a-493a-8a39-6eb1eca87fce, kind: Service { id: aee758cf-32a6-43a0-8b4b-a8989f72d531 }, name: Name("nexus-aee758cf-32a6-43a0-8b4b-a8989f72d531"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7869775-ccb5-47cf-bca2-55ff9ee6115e, kind: Service { id: edb0eecb-56ec-46b8-87b6-99fdeeb62e9d }, name: Name("nexus-edb0eecb-56ec-46b8-87b6-99fdeeb62e9d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14792024-08-27T23:45:24.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14802024-08-27T23:45:24.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14812024-08-27T23:45:24.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14822024-08-27T23:45:24.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
14832024-08-27T23:45:24.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14842024-08-27T23:45:24.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14852024-08-27T23:45:24.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53574 req_id = 737cbd09-4c22-4f40-8ef7-289374ae7f35 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14862024-08-27T23:45:24.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55638
14872024-08-27T23:45:24.386ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0abb08aa-37a9-4359-9f08-d102aa69d873, kind: Service { id: 38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9 }, name: Name("external-dns-38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e04c923d-1d17-4da7-81a5-03c4e09a42eb, kind: Service { id: f234ca35-e74e-4ba9-a39b-f891fe9b9788 }, name: Name("external-dns-f234ca35-e74e-4ba9-a39b-f891fe9b9788"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03953ab4-5e4b-4217-a282-77728d3289c1, kind: Service { id: 8585144e-b855-4b7b-ae74-8c995cbc658b }, name: Name("nexus-8585144e-b855-4b7b-ae74-8c995cbc658b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b1b015a-fe2a-493a-8a39-6eb1eca87fce, kind: Service { id: aee758cf-32a6-43a0-8b4b-a8989f72d531 }, name: Name("nexus-aee758cf-32a6-43a0-8b4b-a8989f72d531"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7869775-ccb5-47cf-bca2-55ff9ee6115e, kind: Service { id: edb0eecb-56ec-46b8-87b6-99fdeeb62e9d }, name: Name("nexus-edb0eecb-56ec-46b8-87b6-99fdeeb62e9d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14882024-08-27T23:45:24.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14892024-08-27T23:45:24.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14902024-08-27T23:45:24.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14912024-08-27T23:45:24.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
14922024-08-27T23:45:24.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14932024-08-27T23:45:24.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14942024-08-27T23:45:24.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55638 req_id = 05a8cbea-3301-48af-a297-3ec256b81d99 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14952024-08-27T23:45:24.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43911
14962024-08-27T23:45:24.451ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0abb08aa-37a9-4359-9f08-d102aa69d873, kind: Service { id: 38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9 }, name: Name("external-dns-38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e04c923d-1d17-4da7-81a5-03c4e09a42eb, kind: Service { id: f234ca35-e74e-4ba9-a39b-f891fe9b9788 }, name: Name("external-dns-f234ca35-e74e-4ba9-a39b-f891fe9b9788"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03953ab4-5e4b-4217-a282-77728d3289c1, kind: Service { id: 8585144e-b855-4b7b-ae74-8c995cbc658b }, name: Name("nexus-8585144e-b855-4b7b-ae74-8c995cbc658b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b1b015a-fe2a-493a-8a39-6eb1eca87fce, kind: Service { id: aee758cf-32a6-43a0-8b4b-a8989f72d531 }, name: Name("nexus-aee758cf-32a6-43a0-8b4b-a8989f72d531"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7869775-ccb5-47cf-bca2-55ff9ee6115e, kind: Service { id: edb0eecb-56ec-46b8-87b6-99fdeeb62e9d }, name: Name("nexus-edb0eecb-56ec-46b8-87b6-99fdeeb62e9d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14972024-08-27T23:45:24.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14982024-08-27T23:45:24.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14992024-08-27T23:45:24.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15002024-08-27T23:45:24.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
15012024-08-27T23:45:24.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15022024-08-27T23:45:24.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15032024-08-27T23:45:24.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 795 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43911 req_id = 422a0abe-97b2-4fcd-b733-aa9f838f6ab7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15042024-08-27T23:45:31.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53501
15052024-08-27T23:45:31.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53501 req_id = c4366016-d2fa-4a58-9c81-7d084287681b response_code = 200 uri = /vpc-routes
15062024-08-27T23:45:31.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53501 req_id = 12fc6f52-3005-4dda-8579-1c797f725cc9 response_code = 204 uri = /vpc-routes
15072024-08-27T23:45:42.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50113
15082024-08-27T23:45:42.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50113 req_id = 1259c2a6-fff0-4a93-bdcd-6d7b7e328c0b response_code = 200 uri = /vpc-routes
15092024-08-27T23:45:42.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 656 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50113 req_id = 3a3eae28-51cc-41b6-8047-64a786760fda response_code = 204 uri = /vpc-routes
15102024-08-27T23:45:42.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59872
15112024-08-27T23:45:42.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59872 req_id = 98338bba-70a9-475f-91e1-139d9f320813 response_code = 200 uri = /v2p
15122024-08-27T23:45:42.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40896
15132024-08-27T23:45:42.896ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15142024-08-27T23:45:42.963ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15152024-08-27T23:45:43.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 134144 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40896 req_id = 97c4bd46-943b-403d-b1e5-7958937b9b2c response_code = 204 uri = /switch-ports
15162024-08-27T23:45:43.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1000 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40896 req_id = ccaab26c-3457-4a1a-bd22-438df71d91c7 response_code = 200 uri = /network-bootstore-config
15172024-08-27T23:45:43.143ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
15182024-08-27T23:45:43.143ZINFOSledAgent (bootstore): Writing ledger to /pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15192024-08-27T23:45:43.144ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15202024-08-27T23:45:43.145ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
15212024-08-27T23:45:43.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2456 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40896 req_id = f56811a4-434b-409f-8391-b0e06dde2a1e response_code = 204 uri = /network-bootstore-config
15222024-08-27T23:45:43.760ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62621
15232024-08-27T23:45:43.760ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62621 req_id = 37da35e2-13dd-4ed8-89c0-070c0ebf7d98 response_code = 200 uri = /baseboard
15242024-08-27T23:45:44.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63838
15252024-08-27T23:45:44.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63838 req_id = 53ed513a-70a1-420e-b78f-57ebbccd43b7 response_code = 200 uri = /vpc-routes
15262024-08-27T23:45:44.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63838 req_id = 53ef1604-7b7f-4060-9728-e57191a5185b response_code = 204 uri = /vpc-routes
15272024-08-27T23:45:44.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48770
15282024-08-27T23:45:44.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48770 req_id = 4c20bc7f-ce92-48b2-bff5-69114820a27e response_code = 200 uri = /v2p
15292024-08-27T23:45:44.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33623
15302024-08-27T23:45:44.305ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15312024-08-27T23:45:44.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15322024-08-27T23:45:44.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91094 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33623 req_id = 7b240892-3e89-44ec-bbd1-bd3a8bef183a response_code = 204 uri = /switch-ports
15332024-08-27T23:45:44.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33064
15342024-08-27T23:45:44.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63034
15352024-08-27T23:45:44.397ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15362024-08-27T23:45:44.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4039 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33623 req_id = 9f7ca204-9425-4fb8-9c7d-714ed37fea49 response_code = 200 uri = /network-bootstore-config
15372024-08-27T23:45:44.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4004 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63034 req_id = 018343a8-53fa-4712-9ed9-306a1bccfa5b response_code = 200 uri = /vpc-routes
15382024-08-27T23:45:44.435ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15392024-08-27T23:45:44.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35457
15402024-08-27T23:45:44.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35457 req_id = 6091fb62-8cf5-4f99-8806-8aa3c5495949 response_code = 200 uri = /v2p
15412024-08-27T23:45:44.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63034 req_id = 3a1dfcdb-c6b3-422a-aebf-11693f0dab99 response_code = 204 uri = /vpc-routes
15422024-08-27T23:45:44.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95511 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33064 req_id = 4f8baae5-0e10-4795-86df-a88b7447441e response_code = 204 uri = /switch-ports
15432024-08-27T23:45:44.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33064 req_id = a05210d1-2360-441e-8aa7-57061c2129aa response_code = 200 uri = /network-bootstore-config
15442024-08-27T23:45:57.199ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:32940 remote_addr = [fd00:1122:3344:101::d]:33508 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564
15452024-08-27T23:45:57.223ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 23696 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = c293136a-7fd7-4a74-8800-622c3eb16f4a response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
15462024-08-27T23:46:12.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60019
15472024-08-27T23:46:12.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60019 req_id = fb68e2e8-d7ff-4c5f-b979-7b67b643c788 response_code = 200 uri = /v2p
15482024-08-27T23:46:12.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61731
15492024-08-27T23:46:12.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61731 req_id = fbf00e26-d201-4daf-b531-7fb3c9b46ece response_code = 200 uri = /vpc-routes
15502024-08-27T23:46:12.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61731 req_id = 956b5722-07e6-469e-a694-e56c53cca6ef response_code = 204 uri = /vpc-routes
15512024-08-27T23:46:13.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43430
15522024-08-27T23:46:13.206ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15532024-08-27T23:46:13.235ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15542024-08-27T23:46:13.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 80575 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43430 req_id = 16835195-9c98-42fd-a7c7-3b245171af0c response_code = 204 uri = /switch-ports
15552024-08-27T23:46:13.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43430 req_id = 8c3417b5-eb28-475e-8ea3-39e3861047d8 response_code = 200 uri = /network-bootstore-config
15562024-08-27T23:46:13.794ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59119
15572024-08-27T23:46:13.794ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59119 req_id = fc7c9f49-c778-41c7-8dda-187e5e460c86 response_code = 200 uri = /baseboard
15582024-08-27T23:46:14.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44921
15592024-08-27T23:46:14.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44921 req_id = b0773fe8-1dfa-4310-90c8-7dadc572d50b response_code = 200 uri = /vpc-routes
15602024-08-27T23:46:14.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44921 req_id = f71ab88a-8837-44bf-bbd0-74cc084e0942 response_code = 204 uri = /vpc-routes
15612024-08-27T23:46:14.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45202
15622024-08-27T23:46:14.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45202 req_id = 66039148-5a3d-41cd-b789-a28805963766 response_code = 200 uri = /vpc-routes
15632024-08-27T23:46:14.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47877
15642024-08-27T23:46:14.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47877 req_id = b9219a82-6c0d-424f-be92-d18a87ff5d65 response_code = 200 uri = /v2p
15652024-08-27T23:46:14.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45202 req_id = 1949d9d7-b3b0-472e-b0fb-0e5bd6f5c578 response_code = 204 uri = /vpc-routes
15662024-08-27T23:46:14.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62014
15672024-08-27T23:46:14.524ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15682024-08-27T23:46:14.562ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15692024-08-27T23:46:14.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97067 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62014 req_id = 7862ac8a-965c-4e0b-8d4d-4fc9caff5a1f response_code = 204 uri = /switch-ports
15702024-08-27T23:46:14.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61201
15712024-08-27T23:46:14.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60497
15722024-08-27T23:46:14.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61201 req_id = 8ad79bdd-8c61-4b67-8aaf-e17f0c666ca7 response_code = 200 uri = /v2p
15732024-08-27T23:46:14.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62014 req_id = 3e3855ba-b5b8-4914-a177-b78fb0960d3c response_code = 200 uri = /network-bootstore-config
15742024-08-27T23:46:14.621ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15752024-08-27T23:46:14.658ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15762024-08-27T23:46:14.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60497 req_id = 3b74f6d0-990c-4fb1-adf5-9aaa380f42fc response_code = 204 uri = /switch-ports
15772024-08-27T23:46:14.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60497 req_id = cb6ed543-30a7-4ba1-9a26-e6c959145e3d response_code = 200 uri = /network-bootstore-config
15782024-08-27T23:46:27.206ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6346 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = 3b67a303-b54e-475a-9103-78df503c3e66 response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
15792024-08-27T23:46:42.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62713
15802024-08-27T23:46:42.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62713 req_id = be3fa684-2260-4091-998f-0dd97d84196c response_code = 200 uri = /vpc-routes
15812024-08-27T23:46:42.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62713 req_id = 69f116cc-b5e1-4c59-a959-642b66e9c9b8 response_code = 204 uri = /vpc-routes
15822024-08-27T23:46:42.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55522
15832024-08-27T23:46:42.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 802 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55522 req_id = 566872f1-b5df-4467-91c5-29bf1d91b568 response_code = 200 uri = /v2p
15842024-08-27T23:46:42.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39511
15852024-08-27T23:46:42.843ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15862024-08-27T23:46:42.878ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15872024-08-27T23:46:42.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91104 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39511 req_id = 08586d6f-6e24-4ff1-980f-8ca2dea81b40 response_code = 204 uri = /switch-ports
15882024-08-27T23:46:42.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39511 req_id = 0aa232f8-4148-45b0-b80c-2f604b45d45d response_code = 200 uri = /network-bootstore-config
15892024-08-27T23:46:43.832ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52084
15902024-08-27T23:46:43.833ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 635 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52084 req_id = 72deb026-b042-4040-bab7-2f6cc4f96e20 response_code = 200 uri = /baseboard
15912024-08-27T23:46:43.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62480
15922024-08-27T23:46:43.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62480 req_id = e2078087-b3b5-43d9-8e9e-e9d77c7d2386 response_code = 200 uri = /vpc-routes
15932024-08-27T23:46:44.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62480 req_id = 1bfd63c5-b69b-4405-a16d-714a4ede9fab response_code = 204 uri = /vpc-routes
15942024-08-27T23:46:44.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48278
15952024-08-27T23:46:44.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48278 req_id = 2105913f-f1b5-4e9d-8a3d-333d755e4119 response_code = 200 uri = /v2p
15962024-08-27T23:46:44.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62872
15972024-08-27T23:46:44.154ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15982024-08-27T23:46:44.193ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15992024-08-27T23:46:44.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98615 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62872 req_id = 651c681f-8834-4bb6-971a-73b2fe4ba662 response_code = 204 uri = /switch-ports
16002024-08-27T23:46:44.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41167
16012024-08-27T23:46:44.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41167 req_id = ff204ff8-78ff-41ca-a654-51e79068f914 response_code = 200 uri = /vpc-routes
16022024-08-27T23:46:44.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62872 req_id = 47ffb224-8624-4ac5-b91f-785482dd150e response_code = 200 uri = /network-bootstore-config
16032024-08-27T23:46:44.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41167 req_id = 125774c9-aa90-45ce-a544-22f543269356 response_code = 204 uri = /vpc-routes
16042024-08-27T23:46:44.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47659
16052024-08-27T23:46:44.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47659 req_id = fe52500f-24cf-4a7f-b9f8-837363a1eef4 response_code = 200 uri = /v2p
16062024-08-27T23:46:44.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42273
16072024-08-27T23:46:44.424ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16082024-08-27T23:46:44.459ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16092024-08-27T23:46:44.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89001 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42273 req_id = 0dbb2213-fa96-4b1d-b4a0-d8aca0eee375 response_code = 204 uri = /switch-ports
16102024-08-27T23:46:44.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 855 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42273 req_id = d77a4fb9-7b1d-48e1-805d-42f0164cbe4a response_code = 200 uri = /network-bootstore-config
16112024-08-27T23:46:57.206ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6742 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = 01984b10-56b8-4e36-b6ca-06784eea0064 response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
16122024-08-27T23:47:12.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55620
16132024-08-27T23:47:12.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1072 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55620 req_id = 9ec4d29f-b0e0-4daf-acbf-1a402a8af9db response_code = 200 uri = /vpc-routes
16142024-08-27T23:47:12.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55620 req_id = 4cf5059e-3196-469c-9c5c-6b236a85e1c6 response_code = 204 uri = /vpc-routes
16152024-08-27T23:47:12.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56048
16162024-08-27T23:47:12.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56048 req_id = 7fab943d-ef2b-4fa5-9554-5d6799e930ab response_code = 200 uri = /v2p
16172024-08-27T23:47:13.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56743
16182024-08-27T23:47:13.175ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16192024-08-27T23:47:13.215ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16202024-08-27T23:47:13.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56743 req_id = 9f153c0c-a6a5-46c1-b6d5-a4226e181559 response_code = 204 uri = /switch-ports
16212024-08-27T23:47:13.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 600 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56743 req_id = e91d648c-b40e-4193-9940-a8cf5560f0c5 response_code = 200 uri = /network-bootstore-config
16222024-08-27T23:47:13.873ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62570
16232024-08-27T23:47:13.873ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 104 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62570 req_id = 404e98ca-163a-4233-a224-9d3bfde931aa response_code = 200 uri = /baseboard
16242024-08-27T23:47:14.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61771
16252024-08-27T23:47:14.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1499 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61771 req_id = 0708f15c-ec5c-4218-b87d-5386d50fd240 response_code = 200 uri = /vpc-routes
16262024-08-27T23:47:14.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61771 req_id = bafaa526-fbe7-4f79-a17a-397300aa1ebc response_code = 204 uri = /vpc-routes
16272024-08-27T23:47:14.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56451
16282024-08-27T23:47:14.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1015 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56451 req_id = 176c4cb4-dcde-453b-a176-eb3983120320 response_code = 200 uri = /vpc-routes
16292024-08-27T23:47:14.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32804
16302024-08-27T23:47:14.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32804 req_id = 3952b70f-0979-49b6-8720-ff7eedcb75aa response_code = 200 uri = /v2p
16312024-08-27T23:47:14.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56451 req_id = 93893c6c-7ebd-432c-bfa5-15f7c0c4888b response_code = 204 uri = /vpc-routes
16322024-08-27T23:47:14.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63824
16332024-08-27T23:47:14.384ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16342024-08-27T23:47:14.425ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16352024-08-27T23:47:14.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95608 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63824 req_id = 8fa1a6f4-1928-4f6e-9dd0-2d446ed1592e response_code = 204 uri = /switch-ports
16362024-08-27T23:47:14.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63824 req_id = 5f22e4c1-d711-41c0-9a4b-1d718c3466c6 response_code = 200 uri = /network-bootstore-config
16372024-08-27T23:47:14.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38375
16382024-08-27T23:47:14.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38375 req_id = e070c608-59fd-4983-ab05-92b2895f1006 response_code = 200 uri = /v2p
16392024-08-27T23:47:14.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51434
16402024-08-27T23:47:14.700ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16412024-08-27T23:47:14.737ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16422024-08-27T23:47:14.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89303 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51434 req_id = e2ceb723-81d5-4024-8ea7-cea02be7899e response_code = 204 uri = /switch-ports
16432024-08-27T23:47:14.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 837 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51434 req_id = 37369412-b459-4dbb-8546-27baf14a5c75 response_code = 200 uri = /network-bootstore-config
16442024-08-27T23:47:22.615ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
16452024-08-27T23:47:27.207ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6753 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = cbc338c5-c3a5-4368-81a6-a023e895dff0 response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
16462024-08-27T23:47:42.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60379
16472024-08-27T23:47:42.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60379 req_id = 470e62d6-704d-487a-8fe2-7abf063e42ab response_code = 200 uri = /vpc-routes
16482024-08-27T23:47:42.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 915 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60379 req_id = 9e8cd756-28f7-41fd-98c5-5018ba2798f8 response_code = 204 uri = /vpc-routes
16492024-08-27T23:47:42.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61407
16502024-08-27T23:47:42.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61407 req_id = 509296c0-3f1e-4931-81ea-4f626b7064aa response_code = 200 uri = /v2p
16512024-08-27T23:47:42.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58431
16522024-08-27T23:47:42.757ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16532024-08-27T23:47:42.795ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16542024-08-27T23:47:42.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98014 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58431 req_id = 40d5a01b-ac9d-4d1a-bc86-1ebec194fe1e response_code = 204 uri = /switch-ports
16552024-08-27T23:47:42.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58431 req_id = 74f5739e-d5dd-4b08-84a6-0ecb09a2799b response_code = 200 uri = /network-bootstore-config
16562024-08-27T23:47:43.914ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65330
16572024-08-27T23:47:43.914ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 48 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65330 req_id = 88f25d39-2303-4b77-bd0a-8006cdb5b026 response_code = 200 uri = /baseboard
16582024-08-27T23:47:44.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35084
16592024-08-27T23:47:44.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35084 req_id = 69315414-1117-4787-b73a-3db234674d2e response_code = 200 uri = /vpc-routes
16602024-08-27T23:47:44.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 919 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35084 req_id = c5f3818d-45fe-40f5-ad14-c8d6aac4b9ce response_code = 204 uri = /vpc-routes
16612024-08-27T23:47:44.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59003
16622024-08-27T23:47:44.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59003 req_id = 85b32969-a2a6-4590-9e65-849ccc540a69 response_code = 200 uri = /v2p
16632024-08-27T23:47:44.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39715
16642024-08-27T23:47:44.211ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16652024-08-27T23:47:44.248ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16662024-08-27T23:47:44.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39715 req_id = e3114a97-c52a-4f3c-9ced-2cc15b989c29 response_code = 204 uri = /switch-ports
16672024-08-27T23:47:44.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56127
16682024-08-27T23:47:44.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56127 req_id = 4d9507e5-90f0-43fe-a01e-a1ff00e38b2a response_code = 200 uri = /vpc-routes
16692024-08-27T23:47:44.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39715 req_id = 62531c82-10d7-474e-802c-11be45247482 response_code = 200 uri = /network-bootstore-config
16702024-08-27T23:47:44.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 795 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56127 req_id = 53fae515-30c4-434e-928e-06a03f843683 response_code = 204 uri = /vpc-routes
16712024-08-27T23:47:44.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50065
16722024-08-27T23:47:44.406ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16732024-08-27T23:47:44.447ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16742024-08-27T23:47:44.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95824 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50065 req_id = 08fc3394-941e-416e-a4c0-eb18c10c991b response_code = 204 uri = /switch-ports
16752024-08-27T23:47:44.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34523
16762024-08-27T23:47:44.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34523 req_id = 8158dee2-b975-49b5-8db2-b2558cff698d response_code = 200 uri = /v2p
16772024-08-27T23:47:44.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 774 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50065 req_id = f9dda343-ae19-46bd-833d-1e486b0c8b79 response_code = 200 uri = /network-bootstore-config
16782024-08-27T23:47:57.217ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5719 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = 16ab03a3-6d55-4333-a073-ec95c8be5e3c response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
16792024-08-27T23:48:12.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37971
16802024-08-27T23:48:12.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1034 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37971 req_id = 8b3fda56-ba30-483e-87c2-98cd40a0dc10 response_code = 200 uri = /vpc-routes
16812024-08-27T23:48:12.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37971 req_id = db0ec0bc-8d7f-483d-a09f-19c318dd1886 response_code = 204 uri = /vpc-routes
16822024-08-27T23:48:12.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59732
16832024-08-27T23:48:12.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 872 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59732 req_id = cf7b39a4-e0df-4d0e-a97c-1c5c61dcc3ff response_code = 200 uri = /v2p
16842024-08-27T23:48:12.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50177
16852024-08-27T23:48:12.916ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16862024-08-27T23:48:12.954ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16872024-08-27T23:48:13.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91072 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50177 req_id = 2a1222cb-ba3c-4967-a4a2-ed17e4c4c097 response_code = 204 uri = /switch-ports
16882024-08-27T23:48:13.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50177 req_id = 5aff0ab5-c02f-4602-b62b-196f9b4afc71 response_code = 200 uri = /network-bootstore-config
16892024-08-27T23:48:13.964ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39495
16902024-08-27T23:48:13.965ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39495 req_id = 5a5721df-6808-4a87-a5c8-2c5f4535c3ca response_code = 200 uri = /baseboard
16912024-08-27T23:48:14.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58030
16922024-08-27T23:48:14.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58030 req_id = 2206881f-a6b0-49c8-9d7e-9185f3762855 response_code = 200 uri = /vpc-routes
16932024-08-27T23:48:14.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58030 req_id = 9994dfe7-c7bd-4c8e-a6df-20dec3a2466e response_code = 204 uri = /vpc-routes
16942024-08-27T23:48:14.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35627
16952024-08-27T23:48:14.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35627 req_id = 5b44f251-615c-4b81-a430-ed7ab0adf31c response_code = 200 uri = /v2p
16962024-08-27T23:48:14.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37278
16972024-08-27T23:48:14.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37278 req_id = 648a2c5f-0ba4-4ad6-9c8e-b8753b403126 response_code = 200 uri = /vpc-routes
16982024-08-27T23:48:14.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37278 req_id = 3843cd9c-37b6-4569-9e6d-a9aef9edd11a response_code = 204 uri = /vpc-routes
16992024-08-27T23:48:14.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36052
17002024-08-27T23:48:14.445ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17012024-08-27T23:48:14.487ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17022024-08-27T23:48:14.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100466 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36052 req_id = 1c816e85-2725-4076-b1c2-4bea1110d25f response_code = 204 uri = /switch-ports
17032024-08-27T23:48:14.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36052 req_id = 4b0f2c95-4816-4778-b992-3ff3190812bc response_code = 200 uri = /network-bootstore-config
17042024-08-27T23:48:14.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65018
17052024-08-27T23:48:14.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65018 req_id = 0d5474c6-203f-444e-ac29-57ca4292a787 response_code = 200 uri = /v2p
17062024-08-27T23:48:14.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46004
17072024-08-27T23:48:14.572ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17082024-08-27T23:48:14.607ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17092024-08-27T23:48:14.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46004 req_id = 44d9f0b0-d61a-4e25-8da2-0ae1f3623ce0 response_code = 204 uri = /switch-ports
17102024-08-27T23:48:14.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46004 req_id = 9675ac30-f4d6-4d6b-8ee2-acc8df49b2f0 response_code = 200 uri = /network-bootstore-config
17112024-08-27T23:48:27.286ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7636 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = 65008426-c025-4827-9bb6-060bb2f59c23 response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
17122024-08-27T23:48:42.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52527
17132024-08-27T23:48:42.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52527 req_id = dd4d75c3-5e0d-4d4c-8a84-63efaa0908bb response_code = 200 uri = /vpc-routes
17142024-08-27T23:48:42.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52527 req_id = acd14e5f-a3a6-41db-9ea4-638e6ae1fc6a response_code = 204 uri = /vpc-routes
17152024-08-27T23:48:42.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58831
17162024-08-27T23:48:42.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 672 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58831 req_id = dd0998c7-3338-4ed4-a30a-e8c17a766ddb response_code = 200 uri = /v2p
17172024-08-27T23:48:42.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37373
17182024-08-27T23:48:42.797ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17192024-08-27T23:48:42.836ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17202024-08-27T23:48:42.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94692 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37373 req_id = 3aaeaf53-3d27-4e04-9a7c-d23d4125a1e5 response_code = 204 uri = /switch-ports
17212024-08-27T23:48:42.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37373 req_id = dac85600-93f0-4e05-b474-88c8e011cb2f response_code = 200 uri = /network-bootstore-config
17222024-08-27T23:48:44.001ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43410
17232024-08-27T23:48:44.001ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43410 req_id = 4127e8a5-a164-45c1-925e-9fba8fa4d6a4 response_code = 200 uri = /baseboard
17242024-08-27T23:48:44.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41237
17252024-08-27T23:48:44.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41237 req_id = 0a9943d0-7fd5-467a-b100-1631dc0fd18b response_code = 200 uri = /vpc-routes
17262024-08-27T23:48:44.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41237 req_id = 7073e91d-97e5-441e-8954-bb6e773febea response_code = 204 uri = /vpc-routes
17272024-08-27T23:48:44.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44640
17282024-08-27T23:48:44.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17292024-08-27T23:48:44.224ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17302024-08-27T23:48:44.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108193 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44640 req_id = f354d8a9-6ab2-49c9-a820-8649256d6f17 response_code = 204 uri = /switch-ports
17312024-08-27T23:48:44.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42737
17322024-08-27T23:48:44.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61077
17332024-08-27T23:48:44.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42737 req_id = 311ce5fe-3d31-4e77-b0de-2f3f1a9d1407 response_code = 200 uri = /vpc-routes
17342024-08-27T23:48:44.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61077 req_id = cddc1cec-1aca-468b-9557-4cdfeab997c1 response_code = 200 uri = /v2p
17352024-08-27T23:48:44.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44640 req_id = 46f72139-d746-4952-9914-dc588b83d675 response_code = 200 uri = /network-bootstore-config
17362024-08-27T23:48:44.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42115
17372024-08-27T23:48:44.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42115 req_id = f5d8b2c6-fbeb-459b-ac52-2e4243e21bd9 response_code = 200 uri = /v2p
17382024-08-27T23:48:44.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 720 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42737 req_id = 9db95aa4-4263-49f2-a52a-9199702630f8 response_code = 204 uri = /vpc-routes
17392024-08-27T23:48:44.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33419
17402024-08-27T23:48:44.384ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17412024-08-27T23:48:44.439ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17422024-08-27T23:48:44.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 120212 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33419 req_id = a4d52c52-b067-4f11-a980-feef832494f6 response_code = 204 uri = /switch-ports
17432024-08-27T23:48:44.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33419 req_id = d66a126b-7c8b-4eeb-a88f-21dfb3d405d6 response_code = 200 uri = /network-bootstore-config
17442024-08-27T23:48:57.285ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6790 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = 5c502236-3759-4380-8b57-5502137b8ed6 response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
17452024-08-27T23:49:12.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53315
17462024-08-27T23:49:12.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53315 req_id = 35430532-91b1-41ee-a3c4-c2bcfde24554 response_code = 200 uri = /vpc-routes
17472024-08-27T23:49:12.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46143
17482024-08-27T23:49:12.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46143 req_id = d02bd649-cdc3-409f-a334-c44d2cfbd895 response_code = 200 uri = /v2p
17492024-08-27T23:49:12.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53315 req_id = 534f0725-9fb1-4ba9-adee-e1d3dfa512d8 response_code = 204 uri = /vpc-routes
17502024-08-27T23:49:12.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59841
17512024-08-27T23:49:12.987ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17522024-08-27T23:49:13.029ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17532024-08-27T23:49:13.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99599 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59841 req_id = 68364a47-dad7-4bab-ae0a-277c6597af0f response_code = 204 uri = /switch-ports
17542024-08-27T23:49:13.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59841 req_id = 4d015cf3-9ef7-4767-bfed-8196872dc0a7 response_code = 200 uri = /network-bootstore-config
17552024-08-27T23:49:14.055ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60611
17562024-08-27T23:49:14.055ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60611 req_id = 368bb085-9df0-4125-849e-0f325911903b response_code = 200 uri = /baseboard
17572024-08-27T23:49:14.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45748
17582024-08-27T23:49:14.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45748 req_id = c67f8092-e189-4af6-a128-a358d3a3bae6 response_code = 200 uri = /vpc-routes
17592024-08-27T23:49:14.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47305
17602024-08-27T23:49:14.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47305 req_id = be0cd269-a322-4fee-b9d1-38f6a24f7a2a response_code = 200 uri = /v2p
17612024-08-27T23:49:14.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45748 req_id = 6d02152c-106d-42d0-af14-434272d2ad91 response_code = 204 uri = /vpc-routes
17622024-08-27T23:49:14.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41412
17632024-08-27T23:49:14.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41412 req_id = a8fe4092-ee10-4faf-99e1-04bd8b1310b1 response_code = 200 uri = /vpc-routes
17642024-08-27T23:49:14.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41412 req_id = d14ab21e-9ddf-4871-9e61-6e7682672602 response_code = 204 uri = /vpc-routes
17652024-08-27T23:49:14.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53581
17662024-08-27T23:49:14.410ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17672024-08-27T23:49:14.448ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17682024-08-27T23:49:14.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53581 req_id = dccdd3df-74c4-4f4b-9afe-efb1a4dfe899 response_code = 204 uri = /switch-ports
17692024-08-27T23:49:14.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50215
17702024-08-27T23:49:14.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50215 req_id = 722915ce-e3d5-4e05-aa30-29317c9527bf response_code = 200 uri = /v2p
17712024-08-27T23:49:14.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53581 req_id = 510fa8f2-33fe-488b-be9d-0d3c0f130929 response_code = 200 uri = /network-bootstore-config
17722024-08-27T23:49:14.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47934
17732024-08-27T23:49:14.543ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17742024-08-27T23:49:14.578ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17752024-08-27T23:49:14.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 86502 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47934 req_id = c7b5704e-376b-4b54-8f87-bc083ae87a32 response_code = 204 uri = /switch-ports
17762024-08-27T23:49:14.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47934 req_id = 931f9382-b3cd-4103-9f59-ad0478747356 response_code = 200 uri = /network-bootstore-config
17772024-08-27T23:49:27.287ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7257 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = 645a0981-4ef1-4428-b76e-4f2a8610e5af response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
17782024-08-27T23:49:42.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44340
17792024-08-27T23:49:42.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44340 req_id = 854b3854-69bf-4e8f-b966-ae6a42305939 response_code = 200 uri = /vpc-routes
17802024-08-27T23:49:42.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44340 req_id = 597ba06b-5c86-4e72-a264-93912fc70530 response_code = 204 uri = /vpc-routes
17812024-08-27T23:49:42.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35842
17822024-08-27T23:49:42.717ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17832024-08-27T23:49:42.754ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17842024-08-27T23:49:42.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92490 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35842 req_id = 7b1eced8-b800-4159-92ae-ab1671aa9f8d response_code = 204 uri = /switch-ports
17852024-08-27T23:49:42.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51085
17862024-08-27T23:49:42.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1013 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35842 req_id = b46751be-e662-4c03-a907-ba07463865da response_code = 200 uri = /network-bootstore-config
17872024-08-27T23:49:42.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 994 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51085 req_id = 554d8259-b288-485c-a652-a89a00af34e5 response_code = 200 uri = /v2p
17882024-08-27T23:49:44.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46985
17892024-08-27T23:49:44.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46985 req_id = a6955cf5-e668-4cd8-82f7-7336a5e16ec3 response_code = 200 uri = /vpc-routes
17902024-08-27T23:49:44.088ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52409
17912024-08-27T23:49:44.088ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52409 req_id = 935aed8e-8182-4515-a686-d92d873b29e3 response_code = 200 uri = /baseboard
17922024-08-27T23:49:44.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49236
17932024-08-27T23:49:44.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49236 req_id = b617f56f-aa68-4ef8-8a4b-c1f19ccb07be response_code = 200 uri = /v2p
17942024-08-27T23:49:44.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1081 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46985 req_id = 1dc8fa42-3396-4f76-82f4-cbc83d18a4dc response_code = 204 uri = /vpc-routes
17952024-08-27T23:49:44.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34534
17962024-08-27T23:49:44.156ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17972024-08-27T23:49:44.197ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17982024-08-27T23:49:44.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34534 req_id = d61fe867-f72c-49fd-b1fe-c6906f3d9503 response_code = 204 uri = /switch-ports
17992024-08-27T23:49:44.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37086
18002024-08-27T23:49:44.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37086 req_id = f4577369-9073-439c-ba6a-2d9759bb92bc response_code = 200 uri = /vpc-routes
18012024-08-27T23:49:44.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34534 req_id = 312b9a6e-f267-4d7e-8a52-a2e73334bf74 response_code = 200 uri = /network-bootstore-config
18022024-08-27T23:49:44.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37086 req_id = b8abb8a4-3b5a-42b4-9c63-9f5cc50c8519 response_code = 204 uri = /vpc-routes
18032024-08-27T23:49:44.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49107
18042024-08-27T23:49:44.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 811 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49107 req_id = 6d589ab0-84dc-47b2-a238-9255024c61cd response_code = 200 uri = /v2p
18052024-08-27T23:49:44.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49439
18062024-08-27T23:49:44.401ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18072024-08-27T23:49:44.438ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18082024-08-27T23:49:44.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91192 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49439 req_id = 30724411-7997-48cf-84b1-fd90dafca37a response_code = 204 uri = /switch-ports
18092024-08-27T23:49:44.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49439 req_id = 62ba9a0c-48a8-4686-b89a-41f04919a4bc response_code = 200 uri = /network-bootstore-config
18102024-08-27T23:49:57.287ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7469 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = d11fce4d-f0ec-411c-aba2-e3b0a62a7c00 response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
18112024-08-27T23:50:12.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58585
18122024-08-27T23:50:12.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58585 req_id = ee228931-e20c-458d-912b-c4774ed5074b response_code = 200 uri = /vpc-routes
18132024-08-27T23:50:12.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58585 req_id = c5730a0c-919f-4fd0-914e-ab544f59c841 response_code = 204 uri = /vpc-routes
18142024-08-27T23:50:12.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46285
18152024-08-27T23:50:12.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46285 req_id = 84273505-1ab1-4f94-8aa5-51d943bb866c response_code = 200 uri = /v2p
18162024-08-27T23:50:12.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36091
18172024-08-27T23:50:12.887ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18182024-08-27T23:50:12.925ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18192024-08-27T23:50:12.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95107 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36091 req_id = 6ee34f88-59c6-4663-9519-226f92109901 response_code = 204 uri = /switch-ports
18202024-08-27T23:50:12.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36091 req_id = f9dfac24-cb17-4339-b18b-7fa9de60dc54 response_code = 200 uri = /network-bootstore-config
18212024-08-27T23:50:13.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51080
18222024-08-27T23:50:13.126ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0abb08aa-37a9-4359-9f08-d102aa69d873, kind: Service { id: 38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9 }, name: Name("external-dns-38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e04c923d-1d17-4da7-81a5-03c4e09a42eb, kind: Service { id: f234ca35-e74e-4ba9-a39b-f891fe9b9788 }, name: Name("external-dns-f234ca35-e74e-4ba9-a39b-f891fe9b9788"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03953ab4-5e4b-4217-a282-77728d3289c1, kind: Service { id: 8585144e-b855-4b7b-ae74-8c995cbc658b }, name: Name("nexus-8585144e-b855-4b7b-ae74-8c995cbc658b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b1b015a-fe2a-493a-8a39-6eb1eca87fce, kind: Service { id: aee758cf-32a6-43a0-8b4b-a8989f72d531 }, name: Name("nexus-aee758cf-32a6-43a0-8b4b-a8989f72d531"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7869775-ccb5-47cf-bca2-55ff9ee6115e, kind: Service { id: edb0eecb-56ec-46b8-87b6-99fdeeb62e9d }, name: Name("nexus-edb0eecb-56ec-46b8-87b6-99fdeeb62e9d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18232024-08-27T23:50:13.126ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18242024-08-27T23:50:13.126ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18252024-08-27T23:50:13.126ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18262024-08-27T23:50:13.127ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
18272024-08-27T23:50:13.127ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18282024-08-27T23:50:13.127ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18292024-08-27T23:50:13.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1037 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51080 req_id = 984d5cd0-bdab-4fd7-89a0-3cf9a03f3e9e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18302024-08-27T23:50:14.127ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64654
18312024-08-27T23:50:14.128ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1021 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64654 req_id = 549efe5b-02ea-4567-a658-217c5605f9b5 response_code = 200 uri = /baseboard
18322024-08-27T23:50:14.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38543
18332024-08-27T23:50:14.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 966 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38543 req_id = 234bec10-4cb9-4753-a69f-6d95474d4401 response_code = 200 uri = /vpc-routes
18342024-08-27T23:50:14.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38543 req_id = 80e5cde4-13df-4ccf-8124-dd0a8f52e225 response_code = 204 uri = /vpc-routes
18352024-08-27T23:50:14.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41905
18362024-08-27T23:50:14.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41905 req_id = 11eb469a-4e58-45ce-bee9-4cde33004052 response_code = 200 uri = /v2p
18372024-08-27T23:50:14.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35159
18382024-08-27T23:50:14.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35159 req_id = 65c2f10d-196f-4c0c-b56a-b969e6f1bc3c response_code = 200 uri = /vpc-routes
18392024-08-27T23:50:14.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35159 req_id = 8abc0724-3f28-40b4-9c94-4b9242f7ce7f response_code = 204 uri = /vpc-routes
18402024-08-27T23:50:14.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39067
18412024-08-27T23:50:14.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 893 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39067 req_id = 72bec543-b349-49e8-9863-88a8f7dd6fe3 response_code = 200 uri = /v2p
18422024-08-27T23:50:14.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51222
18432024-08-27T23:50:14.538ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18442024-08-27T23:50:14.579ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18452024-08-27T23:50:14.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51222 req_id = 3255c608-dd85-4703-bca7-674956b1c1f4 response_code = 204 uri = /switch-ports
18462024-08-27T23:50:14.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59941
18472024-08-27T23:50:14.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51222 req_id = 65d78992-f56c-4b8a-af55-e870706a29f8 response_code = 200 uri = /network-bootstore-config
18482024-08-27T23:50:14.637ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0abb08aa-37a9-4359-9f08-d102aa69d873, kind: Service { id: 38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9 }, name: Name("external-dns-38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e04c923d-1d17-4da7-81a5-03c4e09a42eb, kind: Service { id: f234ca35-e74e-4ba9-a39b-f891fe9b9788 }, name: Name("external-dns-f234ca35-e74e-4ba9-a39b-f891fe9b9788"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03953ab4-5e4b-4217-a282-77728d3289c1, kind: Service { id: 8585144e-b855-4b7b-ae74-8c995cbc658b }, name: Name("nexus-8585144e-b855-4b7b-ae74-8c995cbc658b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b1b015a-fe2a-493a-8a39-6eb1eca87fce, kind: Service { id: aee758cf-32a6-43a0-8b4b-a8989f72d531 }, name: Name("nexus-aee758cf-32a6-43a0-8b4b-a8989f72d531"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7869775-ccb5-47cf-bca2-55ff9ee6115e, kind: Service { id: edb0eecb-56ec-46b8-87b6-99fdeeb62e9d }, name: Name("nexus-edb0eecb-56ec-46b8-87b6-99fdeeb62e9d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18492024-08-27T23:50:14.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18502024-08-27T23:50:14.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18512024-08-27T23:50:14.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18522024-08-27T23:50:14.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
18532024-08-27T23:50:14.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18542024-08-27T23:50:14.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18552024-08-27T23:50:14.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59941 req_id = abd37f21-299c-4c84-8a72-9f06c98b8d25 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18562024-08-27T23:50:14.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43353
18572024-08-27T23:50:14.753ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0abb08aa-37a9-4359-9f08-d102aa69d873, kind: Service { id: 38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9 }, name: Name("external-dns-38b61f53-1ab7-4cd8-8311-8f7b1a6d9db9"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e04c923d-1d17-4da7-81a5-03c4e09a42eb, kind: Service { id: f234ca35-e74e-4ba9-a39b-f891fe9b9788 }, name: Name("external-dns-f234ca35-e74e-4ba9-a39b-f891fe9b9788"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03953ab4-5e4b-4217-a282-77728d3289c1, kind: Service { id: 8585144e-b855-4b7b-ae74-8c995cbc658b }, name: Name("nexus-8585144e-b855-4b7b-ae74-8c995cbc658b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b1b015a-fe2a-493a-8a39-6eb1eca87fce, kind: Service { id: aee758cf-32a6-43a0-8b4b-a8989f72d531 }, name: Name("nexus-aee758cf-32a6-43a0-8b4b-a8989f72d531"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7869775-ccb5-47cf-bca2-55ff9ee6115e, kind: Service { id: edb0eecb-56ec-46b8-87b6-99fdeeb62e9d }, name: Name("nexus-edb0eecb-56ec-46b8-87b6-99fdeeb62e9d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18582024-08-27T23:50:14.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18592024-08-27T23:50:14.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18602024-08-27T23:50:14.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18612024-08-27T23:50:14.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
18622024-08-27T23:50:14.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18632024-08-27T23:50:14.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18642024-08-27T23:50:14.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43353 req_id = 2828366f-c5a3-443c-9399-40f7a4289132 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18652024-08-27T23:50:14.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37772
18662024-08-27T23:50:14.776ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18672024-08-27T23:50:14.811ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18682024-08-27T23:50:14.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 83159 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37772 req_id = 6e09ceec-2a0d-45c9-b8e9-451f1ab910b8 response_code = 204 uri = /switch-ports
18692024-08-27T23:50:14.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37772 req_id = b70ed3a3-c241-456a-8ee8-0de2e84bbbd9 response_code = 200 uri = /network-bootstore-config
18702024-08-27T23:50:27.286ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6290 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = b7ae87bc-aefd-44fa-adc2-8682c550ea22 response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
18712024-08-27T23:50:42.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37464
18722024-08-27T23:50:42.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37464 req_id = f808147b-85df-4511-bb41-4c9fea7c8b60 response_code = 200 uri = /vpc-routes
18732024-08-27T23:50:42.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37464 req_id = 59bc198f-8aab-4f69-b674-30a3b9b5de7a response_code = 204 uri = /vpc-routes
18742024-08-27T23:50:42.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37916
18752024-08-27T23:50:42.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37916 req_id = bb316562-ccb3-481f-9533-44849b47085e response_code = 200 uri = /v2p
18762024-08-27T23:50:42.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45484
18772024-08-27T23:50:42.775ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18782024-08-27T23:50:42.813ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18792024-08-27T23:50:42.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91327 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45484 req_id = 792e0c9a-62b4-411e-b2d3-9bf1324e03e6 response_code = 204 uri = /switch-ports
18802024-08-27T23:50:42.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45484 req_id = 93149433-64ca-4ecf-820c-bbb7ab18ebf9 response_code = 200 uri = /network-bootstore-config
18812024-08-27T23:50:44.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45840
18822024-08-27T23:50:44.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45840 req_id = be859ae4-3659-4cf3-825e-bfb9974f5560 response_code = 200 uri = /vpc-routes
18832024-08-27T23:50:44.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1059 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45840 req_id = 1238a389-36db-4bf6-950c-7830a9677be8 response_code = 204 uri = /vpc-routes
18842024-08-27T23:50:44.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40623
18852024-08-27T23:50:44.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40623 req_id = 81cbca55-f65b-4d5c-909d-33fa0944fab1 response_code = 200 uri = /v2p
18862024-08-27T23:50:44.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33027
18872024-08-27T23:50:44.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33027 req_id = 0c258890-1444-4440-99e6-833b41a5cf18 response_code = 200 uri = /vpc-routes
18882024-08-27T23:50:44.168ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55693
18892024-08-27T23:50:44.169ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 434 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55693 req_id = be5912c9-d138-4761-93f7-fb87aec52dc0 response_code = 200 uri = /baseboard
18902024-08-27T23:50:44.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33027 req_id = 8dadbb95-b63b-4b66-9c8d-08053ce55ca0 response_code = 204 uri = /vpc-routes
18912024-08-27T23:50:44.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53573
18922024-08-27T23:50:44.197ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18932024-08-27T23:50:44.239ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18942024-08-27T23:50:44.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 102607 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53573 req_id = 836bba34-dcfb-49a9-b288-18bff9c835dc response_code = 204 uri = /switch-ports
18952024-08-27T23:50:44.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44037
18962024-08-27T23:50:44.301ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18972024-08-27T23:50:44.336ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18982024-08-27T23:50:44.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 88762 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44037 req_id = 387ecd74-6735-4a42-ab4c-d95b32cc4f38 response_code = 204 uri = /switch-ports
18992024-08-27T23:50:44.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61743
19002024-08-27T23:50:44.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61743 req_id = 22a63f22-9376-49e5-8d3b-5268b34b1666 response_code = 200 uri = /v2p
19012024-08-27T23:50:44.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53573 req_id = e04526b5-1695-4210-a161-d5a5d5d5b957 response_code = 200 uri = /network-bootstore-config
19022024-08-27T23:50:44.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44037 req_id = 3abeb312-80ba-4b58-9a02-c32832b61153 response_code = 200 uri = /network-bootstore-config
19032024-08-27T23:50:57.400ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6718 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = 45c265d4-5d8e-4ae4-a377-a0f9cb776019 response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
19042024-08-27T23:51:12.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63459
19052024-08-27T23:51:12.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63459 req_id = e224b32f-b77c-4a96-bf57-c85ca9f2fe9b response_code = 200 uri = /vpc-routes
19062024-08-27T23:51:12.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56463
19072024-08-27T23:51:12.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56463 req_id = 64b085d8-9e32-4aa2-bf78-d16a36ff1149 response_code = 200 uri = /v2p
19082024-08-27T23:51:12.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63459 req_id = df62e8d4-04c1-4cbb-96c9-1a82e41ae5c2 response_code = 204 uri = /vpc-routes
19092024-08-27T23:51:13.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36248
19102024-08-27T23:51:13.007ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
19112024-08-27T23:51:13.046ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
19122024-08-27T23:51:13.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96958 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36248 req_id = 2ca0c6bd-9b8e-4d8b-bcbb-bf5b5b305bdf response_code = 204 uri = /switch-ports
19132024-08-27T23:51:13.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36248 req_id = 47f42e5e-619b-4eb7-87dd-4ec9036eb002 response_code = 200 uri = /network-bootstore-config
19142024-08-27T23:51:14.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45073
19152024-08-27T23:51:14.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45073 req_id = 4ddc419e-5e43-4cca-83de-0e618e5dee27 response_code = 200 uri = /vpc-routes
19162024-08-27T23:51:14.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45073 req_id = 338228a3-4c0d-4e4a-8108-740a254c7196 response_code = 204 uri = /vpc-routes
19172024-08-27T23:51:14.214ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51572
19182024-08-27T23:51:14.214ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51572 req_id = d64bc474-679e-491f-928c-edcfd09d80c5 response_code = 200 uri = /baseboard
19192024-08-27T23:51:14.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35577
19202024-08-27T23:51:14.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35577 req_id = 249fbb45-a4e1-4068-8265-4dac84986316 response_code = 200 uri = /vpc-routes
19212024-08-27T23:51:14.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35577 req_id = 3f982745-dc5d-446e-ae0b-f6f5d9211e1e response_code = 204 uri = /vpc-routes
19222024-08-27T23:51:14.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50021
19232024-08-27T23:51:14.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 839 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50021 req_id = 2880fabf-494e-40c2-9fec-927b585861c7 response_code = 200 uri = /v2p
19242024-08-27T23:51:14.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61871
19252024-08-27T23:51:14.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61871 req_id = f4833b5d-efa2-452f-9152-49fd8f812532 response_code = 200 uri = /v2p
19262024-08-27T23:51:14.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38859
19272024-08-27T23:51:14.527ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
19282024-08-27T23:51:14.565ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
19292024-08-27T23:51:14.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93958 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38859 req_id = 478b9500-ab05-4883-b6cb-c8a4c33c6fd5 response_code = 204 uri = /switch-ports
19302024-08-27T23:51:14.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34802
19312024-08-27T23:51:14.621ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
19322024-08-27T23:51:14.654ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
19332024-08-27T23:51:14.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89353 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34802 req_id = 2c024b6f-ce2d-44db-ac58-e8de3ec3ccb1 response_code = 204 uri = /switch-ports
19342024-08-27T23:51:14.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38859 req_id = 25e45c2f-0f64-4780-b6dd-c244ba136267 response_code = 200 uri = /network-bootstore-config
19352024-08-27T23:51:14.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34802 req_id = 16126527-210f-4254-9617-f35246060d34 response_code = 200 uri = /network-bootstore-config
19362024-08-27T23:51:27.400ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6826 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = ee9492fe-29e8-4e75-ad78-f98de2978840 response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
19372024-08-27T23:51:33.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37180
19382024-08-27T23:51:33.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 689 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37180 req_id = abeacc47-c9b2-4c38-8d22-bbdb3b84f8b3 response_code = 200 uri = /v2p
19392024-08-27T23:51:33.269ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:778 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 252, 205, 189])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(14811041) }
19402024-08-27T23:51:33.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1358 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37180 req_id = d7aa9c0a-34ab-4422-9f0a-de68ff665d60 response_code = 204 uri = /v2p
19412024-08-27T23:51:33.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51117
19422024-08-27T23:51:33.399ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:570 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 76f0d059-2863-4f81-8d0c-069e60372cd8, kind: Instance { id: f53b8f65-8197-4a3c-ab18-c2e80f2eb176 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 252, 205, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14811041), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 76f0d059-2863-4f81-8d0c-069e60372cd8, kind: Instance { id: f53b8f65-8197-4a3c-ab18-c2e80f2eb176 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 252, 205, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14811041), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 76f0d059-2863-4f81-8d0c-069e60372cd8, kind: Instance { id: f53b8f65-8197-4a3c-ab18-c2e80f2eb176 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 252, 205, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14811041), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14811041))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 76f0d059-2863-4f81-8d0c-069e60372cd8, kind: Instance { id: f53b8f65-8197-4a3c-ab18-c2e80f2eb176 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 252, 205, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14811041), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-c749fdb4934", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 7ca320d0-371b-43b9-a327-857ece1bd9a4, read_only_parent: Some(Volume { block_size: 512, id: 8728b263-72b2-4e84-9e60-87e8f5da9a6e, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: a70612dd-5fb3-426a-ab24-f201d3d69a03, key: Some("WTTclGSYkU/HsSVKc0l8qULsUGSq1kfqGAL4MUTKKRw="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7ca320d0-371b-43b9-a327-857ece1bd9a4, key: Some("zhfR8RVDWK0M2o9rrGTR4Mhlw8NeK6LCx34jI5Po5Ws="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some(..) } instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 instance_runtime = InstanceRuntimeState { propolis_id: Some(c654551b-e3a6-4219-9d08-5e8795022998 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-08-27T23:51:32.941755918Z } metadata = InstanceMetadata { silo_id: 12427b3f-f7aa-4fa9-acdb-53f38afac222, project_id: 5b9058a5-792b-491e-a189-0ea78414e572 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-08-27T23:51:32.869952Z }
19432024-08-27T23:51:33.399ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:603 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19442024-08-27T23:51:33.399ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:991 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 migration_id = None propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 76f0d059-2863-4f81-8d0c-069e60372cd8, kind: Instance { id: f53b8f65-8197-4a3c-ab18-c2e80f2eb176 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 252, 205, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14811041), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 76f0d059-2863-4f81-8d0c-069e60372cd8, kind: Instance { id: f53b8f65-8197-4a3c-ab18-c2e80f2eb176 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 252, 205, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14811041), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 76f0d059-2863-4f81-8d0c-069e60372cd8, kind: Instance { id: f53b8f65-8197-4a3c-ab18-c2e80f2eb176 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 252, 205, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14811041), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14811041))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 76f0d059-2863-4f81-8d0c-069e60372cd8, kind: Instance { id: f53b8f65-8197-4a3c-ab18-c2e80f2eb176 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 252, 205, 189])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14811041), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-c749fdb4934", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 7ca320d0-371b-43b9-a327-857ece1bd9a4, read_only_parent: Some(Volume { block_size: 512, id: 8728b263-72b2-4e84-9e60-87e8f5da9a6e, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: a70612dd-5fb3-426a-ab24-f201d3d69a03, key: Some("WTTclGSYkU/HsSVKc0l8qULsUGSq1kfqGAL4MUTKKRw="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7ca320d0-371b-43b9-a327-857ece1bd9a4, key: Some("zhfR8RVDWK0M2o9rrGTR4Mhlw8NeK6LCx34jI5Po5Ws="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-08-27T23:51:32.869952Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
19452024-08-27T23:51:33.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7466 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51117 req_id = ba1ee0c4-5e71-4be2-8d19-b6d381b8c4c5 response_code = 200 uri = /vmms/c654551b-e3a6-4219-9d08-5e8795022998
19462024-08-27T23:51:33.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33408
19472024-08-27T23:51:33.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1441 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33408 req_id = 36bdb33e-96b0-4aef-8137-24e8191a20d1 response_code = 200 uri = /vmms/c654551b-e3a6-4219-9d08-5e8795022998/state
19482024-08-27T23:51:33.475ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 252, 205, 189]), slot: 0, vni: Vni { inner: 14811041 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
19492024-08-27T23:51:33.475ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
19502024-08-27T23:51:33.513ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998 file = illumos-utils/src/zone.rs:316 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19512024-08-27T23:51:33.534ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998 file = illumos-utils/src/zone.rs:354 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19522024-08-27T23:51:34.828ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19532024-08-27T23:51:34.828ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998 zone file = illumos-utils/src/running_zone.rs:488 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 zone = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
19542024-08-27T23:51:35.084ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 65.867325ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 zone = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
19552024-08-27T23:51:35.164ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 108.959369ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 zone = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
19562024-08-27T23:51:35.289ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 295.283931ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 zone = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
19572024-08-27T23:51:35.598ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 263.857416ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 zone = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
19582024-08-27T23:51:35.880ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 1.048208429s file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 zone = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
19592024-08-27T23:51:36.940ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 1.417266036s file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 zone = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
19602024-08-27T23:51:38.370ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 854.789413ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 zone = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
19612024-08-27T23:51:39.237ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 860.063885ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 zone = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
19622024-08-27T23:51:40.107ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 711.563238ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 zone = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
19632024-08-27T23:51:40.831ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 705.861289ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 zone = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
19642024-08-27T23:51:41.565ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998 file = sled-agent/src/instance.rs:1449 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19652024-08-27T23:51:41.574ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 72.720437ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19662024-08-27T23:51:41.657ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 66.174155ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19672024-08-27T23:51:41.732ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 175.709336ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19682024-08-27T23:51:41.920ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998") failed: Property not found. retry in 491.801614ms file = illumos-utils/src/svc.rs:36 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19692024-08-27T23:51:42.423ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1458 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19702024-08-27T23:51:42.468ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1482 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19712024-08-27T23:51:42.636ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:727 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19722024-08-27T23:51:42.639ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-08-27T23:51:42.639111973Z } file = sled-agent/src/instance.rs:594 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19732024-08-27T23:51:42.639ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-27T23:51:42.639111973Z } propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19742024-08-27T23:51:42.639ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-27T23:51:42.639111973Z }, migration_in: None, migration_out: None }
19752024-08-27T23:51:42.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33317
19762024-08-27T23:51:42.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 105144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33317 req_id = 646fe223-13a0-4b3f-b837-b35a24cce543 response_code = 200 uri = /vmms/c654551b-e3a6-4219-9d08-5e8795022998/state
19772024-08-27T23:51:42.746ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-08-27T23:51:42.746174255Z } file = sled-agent/src/instance.rs:594 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19782024-08-27T23:51:42.746ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-27T23:51:42.746174255Z } propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
19792024-08-27T23:51:42.746ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-27T23:51:42.746174255Z }, migration_in: None, migration_out: None }
19802024-08-27T23:51:42.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44077
19812024-08-27T23:51:42.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44077 req_id = cbb166b0-82d0-4894-8875-022f918e61ec response_code = 200 uri = /vpc-routes
19822024-08-27T23:51:42.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64884
19832024-08-27T23:51:42.798ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
19842024-08-27T23:51:42.840ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
19852024-08-27T23:51:42.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100247 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64884 req_id = a08981a7-eb2e-4e73-ba22-8f4c9ae3429a response_code = 204 uri = /switch-ports
19862024-08-27T23:51:42.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41008
19872024-08-27T23:51:42.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 905 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64884 req_id = 684e010b-d895-4dd2-9bf0-c623fc6cddb1 response_code = 200 uri = /network-bootstore-config
19882024-08-27T23:51:42.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 882 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41008 req_id = 270fdd7a-3058-4d79-b1bc-dcad508ccdb1 response_code = 200 uri = /v2p
19892024-08-27T23:51:42.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44077 req_id = a1e04db5-0a98-4972-90ab-db28d7ab18ef response_code = 204 uri = /vpc-routes
19902024-08-27T23:51:44.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38520
19912024-08-27T23:51:44.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38520 req_id = bcfb1dc5-2a13-4f3c-96c5-e5c573049b33 response_code = 200 uri = /vmms/c654551b-e3a6-4219-9d08-5e8795022998/state
19922024-08-27T23:51:44.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39549
19932024-08-27T23:51:44.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39549 req_id = 6f413a66-e536-41f5-b883-6d3a61b183c0 response_code = 200 uri = /vpc-routes
19942024-08-27T23:51:44.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39549 req_id = d551039d-0cfd-4f48-8722-0671b362a79a response_code = 204 uri = /vpc-routes
19952024-08-27T23:51:44.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33158
19962024-08-27T23:51:44.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33158 req_id = 4ddaba09-d8dc-4646-bc2e-de10660b79ca response_code = 200 uri = /v2p
19972024-08-27T23:51:44.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35070
19982024-08-27T23:51:44.199ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
19992024-08-27T23:51:44.238ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
20002024-08-27T23:51:44.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 102526 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35070 req_id = acdf45d7-8ec7-45ef-ad3d-23692cbb34a4 response_code = 204 uri = /switch-ports
20012024-08-27T23:51:44.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58617
20022024-08-27T23:51:44.301ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55478
20032024-08-27T23:51:44.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37905
20042024-08-27T23:51:44.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58617 req_id = 8ebdcfcc-454e-484f-bda3-77b438211773 response_code = 200 uri = /vpc-routes
20052024-08-27T23:51:44.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35070 req_id = 980d31dc-cb48-45fd-b23d-007deca01bf9 response_code = 200 uri = /network-bootstore-config
20062024-08-27T23:51:44.302ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1073 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55478 req_id = fcc2cfdf-c6df-436e-be56-3edd6aab58c5 response_code = 200 uri = /baseboard
20072024-08-27T23:51:44.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37905 req_id = 37b44e6c-267e-46ac-9a72-7125a467c338 response_code = 200 uri = /vmms/c654551b-e3a6-4219-9d08-5e8795022998/state
20082024-08-27T23:51:44.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46180
20092024-08-27T23:51:44.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46180 req_id = df235786-d4ce-4852-b5a3-f166319df32b response_code = 200 uri = /v2p
20102024-08-27T23:51:44.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58617 req_id = 1a1b2588-512e-4c6c-bc5d-d1abd04f30da response_code = 204 uri = /vpc-routes
20112024-08-27T23:51:44.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54914
20122024-08-27T23:51:44.396ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
20132024-08-27T23:51:44.438ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
20142024-08-27T23:51:44.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97748 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54914 req_id = 51979245-a361-4099-a981-83bc2e5b7e47 response_code = 204 uri = /switch-ports
20152024-08-27T23:51:44.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 770 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54914 req_id = eaca3e0c-4bb9-4da3-991b-6933371816eb response_code = 200 uri = /network-bootstore-config
20162024-08-27T23:51:51.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55648
20172024-08-27T23:51:51.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55648 req_id = 75481ef6-88a9-4f44-81ed-0385fa044632 response_code = 200 uri = /vmms/c654551b-e3a6-4219-9d08-5e8795022998/state
20182024-08-27T23:51:51.288ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-08-27T23:51:51.288384229Z } file = sled-agent/src/instance.rs:594 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
20192024-08-27T23:51:51.288ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-27T23:51:51.288384229Z } propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
20202024-08-27T23:51:51.288ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-27T23:51:51.288384229Z }, migration_in: None, migration_out: None }
20212024-08-27T23:51:51.396ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-08-27T23:51:51.396222718Z } file = sled-agent/src/instance.rs:594 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
20222024-08-27T23:51:51.396ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-08-27T23:51:51.396222718Z } propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
20232024-08-27T23:51:51.396ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:630 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
20242024-08-27T23:51:51.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
20252024-08-27T23:51:51.419ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
20262024-08-27T23:51:51.421ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/3a897ff0-1a36-48cc-8f8f-7aa15f350d70/debug/bundle/zone", "/pool/int/d36cd2c7-fd8c-4ca8-8fa5-b0b06e427fb8/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/261199e3-73de-407f-8de5-043cbf4ed10d/crypt/debug", "/pool/ext/f5032ea4-6112-4732-b8ee-8f60011c0e16/crypt/debug", "/pool/ext/2f03970d-8389-493d-b912-73626b8d538f/crypt/debug", "/pool/ext/01024d79-0997-4738-a4d3-daf5c97d6e9d/crypt/debug", "/pool/ext/2440f700-b74a-4ef3-85b8-62d810b4ecb0/crypt/debug", "/pool/ext/1df19093-a749-4394-9c32-b41d22eaa752/crypt/debug", "/pool/ext/b6bcbfc4-10ba-4bd2-94ad-4d2075602ee5/crypt/debug", "/pool/ext/58f2cdae-319b-489c-89a1-9d6a173f3e8a/crypt/debug", "/pool/ext/6d2d4b30-dc11-496b-9bd8-e427a70cc372/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998
20272024-08-27T23:51:52.147ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1137 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998", bundle_id: 31ba5507-64dc-4a1e-804a-d7f40d0207be }, time_created: 2024-08-27T23:51:51.421673058Z, version: 0, cause: TerminatedInstance }
20282024-08-27T23:51:52.148ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_c654551b-e3a6-4219-9d08-5e8795022998 file = sled-agent/src/instance.rs:826 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
20292024-08-27T23:51:53.918ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:270 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
20302024-08-27T23:51:53.936ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:904 id = RouterId { vni: Vni(14811041), kind: System }
20312024-08-27T23:51:53.936ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:904 id = RouterId { vni: Vni(14811041), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
20322024-08-27T23:51:53.936ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-27T23:51:53.936798874Z }, migration_in: None, migration_out: None }
20332024-08-27T23:51:53.997ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-27T23:51:53.936798874Z }, migration_in: None, migration_out: None }
20342024-08-27T23:51:54.002ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:763 instance_id = f53b8f65-8197-4a3c-ab18-c2e80f2eb176 propolis_id = c654551b-e3a6-4219-9d08-5e8795022998
20352024-08-27T23:51:54.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59605
20362024-08-27T23:51:54.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 683 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59605 req_id = f91bfa9c-434f-4548-b4d6-dd5417072ecc response_code = 200 uri = /vpc-routes
20372024-08-27T23:51:54.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59605 req_id = 3e196c33-09c5-4c25-b6db-7b6b4b48227d response_code = 204 uri = /vpc-routes
20382024-08-27T23:51:55.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46667
20392024-08-27T23:51:55.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46667 req_id = 27213ee9-cfc4-45d8-b3c2-7dc2080cd26e response_code = 200 uri = /v2p
20402024-08-27T23:51:55.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41988
20412024-08-27T23:51:55.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41988 req_id = f00ca830-4e53-4eb3-991d-1d9faba2b4b4 response_code = 200 uri = /v2p
20422024-08-27T23:51:57.401ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7053 local_addr = [fd00:1122:3344:101::1]:32940 method = GET remote_addr = [fd00:1122:3344:101::d]:33508 req_id = 901465af-01c2-4598-a6a4-999dd976c92f response_code = 200 sled_id = b2ce5e72-9d59-4cfb-87ef-79f549e07564 uri = /b2ce5e72-9d59-4cfb-87ef-79f549e07564
20432024-08-27T23:51:57.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46995
20442024-08-27T23:51:57.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46995 req_id = 19d8ab67-dbf1-4d49-97c5-0eebbd188489 response_code = 200 uri = /vpc-routes
20452024-08-27T23:51:57.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46995 req_id = 2279072c-fb29-4175-b296-e3d4195c5306 response_code = 204 uri = /vpc-routes