Max level shown:
1 [ Aug 3 04:34:54 Enabled. ]
2 [ Aug 3 04:34:55 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Aug 3 04:34:55 Method "start" exited with status 0. ]
4 [ Aug 3 04:34:55 Rereading configuration. ]
5 [ Aug 3 04:34:55 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-08-03T04:34:55.025ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-08-03T04:34:55.025ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-08-03T04:34:55.080ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-08-03T04:34:55.080ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-08-03T04:34:55.194ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-08-03T04:34:55.203ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-08-03T04:34:55.211ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-08-03T04:34:55.815ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-08-03T04:34:55.953ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:125
162024-08-03T04:34:55.953ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:137
172024-08-03T04:34:55.953ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:150
182024-08-03T04:34:55.953ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:172 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-08-03T04:34:55.953ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-08-03T04:34:55.953ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:716
212024-08-03T04:34:55.956ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:623
222024-08-03T04:34:55.956ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:765
232024-08-03T04:34:55.956ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:186
242024-08-03T04:34:55.956ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:824
252024-08-03T04:34:55.956ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/m2_0.vdev
262024-08-03T04:34:55.956ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-08-03T04:34:55.956ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
282024-08-03T04:34:55.956ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-08-03T04:34:55.956ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-08-03T04:34:55.968ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:360
312024-08-03T04:34:55.968ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool)
322024-08-03T04:34:56.067ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal }
332024-08-03T04:34:56.273ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:405
342024-08-03T04:34:56.273ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/m2_1.vdev
352024-08-03T04:34:56.273ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-08-03T04:34:56.274ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-08-03T04:34:56.274ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
382024-08-03T04:34:56.274ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-08-03T04:34:56.274ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-08-03T04:34:56.282ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:360
412024-08-03T04:34:56.282ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool)
422024-08-03T04:34:56.369ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal }
432024-08-03T04:34:56.574ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_0.vdev
442024-08-03T04:34:56.574ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-08-03T04:34:56.574ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-08-03T04:34:56.574ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-08-03T04:34:56.574ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
482024-08-03T04:34:56.574ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-08-03T04:34:56.574ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_1.vdev
502024-08-03T04:34:56.575ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-08-03T04:34:56.575ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
522024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532024-08-03T04:34:56.575ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
542024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-08-03T04:34:56.575ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_2.vdev
562024-08-03T04:34:56.575ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-08-03T04:34:56.575ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
582024-08-03T04:34:56.575ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-08-03T04:34:56.575ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_3.vdev
622024-08-03T04:34:56.575ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-08-03T04:34:56.575ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
662024-08-03T04:34:56.575ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-08-03T04:34:56.575ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_4.vdev
682024-08-03T04:34:56.575ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-08-03T04:34:56.575ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
722024-08-03T04:34:56.575ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-08-03T04:34:56.575ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_5.vdev
742024-08-03T04:34:56.575ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
752024-08-03T04:34:56.575ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
762024-08-03T04:34:56.575ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
772024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792024-08-03T04:34:56.575ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_6.vdev
802024-08-03T04:34:56.575ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
812024-08-03T04:34:56.575ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
822024-08-03T04:34:56.575ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
832024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-08-03T04:34:56.575ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_7.vdev
862024-08-03T04:34:56.575ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892024-08-03T04:34:56.575ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
902024-08-03T04:34:56.575ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-08-03T04:34:56.575ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_8.vdev
922024-08-03T04:34:56.575ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932024-08-03T04:34:56.575ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
942024-08-03T04:34:56.575ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-08-03T04:34:56.575ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:96
982024-08-03T04:34:56.575ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:98
992024-08-03T04:34:56.575ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-08-03T04:34:56.575ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-08-03T04:34:56.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1032024-08-03T04:34:56.575ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:210
1042024-08-03T04:34:56.575ZINFOSledAgent (bootstore): No ledger in /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-08-03T04:34:56.575ZINFOSledAgent (bootstore): No ledger in /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-08-03T04:34:56.575ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-08-03T04:34:56.575ZINFOSledAgent (bootstore): No ledger in /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-08-03T04:34:56.575ZINFOSledAgent (bootstore): No ledger in /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-08-03T04:34:56.575ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-08-03T04:34:56.575ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:215
1112024-08-03T04:34:56.575ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:230
1122024-08-03T04:34:56.586ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:725
1132024-08-03T04:34:56.586ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:292 next_cleanup = Instant { tv_sec: 1316, tv_nsec: 303774889 } time_to_next_cleanup = 599.99995192s
1142024-08-03T04:34:56.586ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3664
1152024-08-03T04:34:56.586ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1162024-08-03T04:34:56.587ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-08-03T04:34:56.589ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-08-03T04:34:56.589ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:205 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-08-03T04:34:56.589ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-08-03T04:34:56.590ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1017
1212024-08-03T04:34:56.590ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1222024-08-03T04:34:56.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1232024-08-03T04:34:56.590ZINFOSledAgent (RSS): No ledger in /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-08-03T04:34:56.590ZINFOSledAgent (RSS): No ledger in /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-08-03T04:34:56.590ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1077
1262024-08-03T04:34:56.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1272024-08-03T04:34:56.590ZINFOSledAgent (RSS): No ledger in /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-08-03T04:34:56.590ZINFOSledAgent (RSS): No ledger in /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-08-03T04:34:56.590ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1118
1302024-08-03T04:34:56.590ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-08-03T04:34:56.590ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-08-03T04:34:56.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1332024-08-03T04:34:56.590ZINFOSledAgent (RSS): Writing ledger to /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-08-03T04:34:56.590ZINFOSledAgent (RSS): Writing ledger to /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-08-03T04:34:56.590ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-08-03T04:34:56.590ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1151
1372024-08-03T04:34:56.590ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-08-03T04:34:56.590ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-08-03T04:34:56.591ZINFOSledAgent (bootstore): Writing ledger to /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-08-03T04:34:56.591ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-08-03T04:34:56.591ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: efa65cdf-dd3f-49ef-9fee-7f962aef90ca, rack_id: bbdaff03-a88f-4e22-b963-265ac181051d, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-08-03T04:34:56.591ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:53890
1432024-08-03T04:34:56.591ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: efa65cdf-dd3f-49ef-9fee-7f962aef90ca, rack_id: bbdaff03-a88f-4e22-b963-265ac181051d, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:359
1442024-08-03T04:34:56.591ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:374
1452024-08-03T04:34:56.591ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1462024-08-03T04:34:56.591ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:405
1472024-08-03T04:34:56.591ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1482024-08-03T04:34:56.591ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1492024-08-03T04:34:56.591ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:573
1502024-08-03T04:34:56.591ZINFOSledAgent (StorageManager): No ledger in /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1512024-08-03T04:34:56.592ZINFOSledAgent (StorageManager): No ledger in /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1522024-08-03T04:34:56.592ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:562
1532024-08-03T04:34:56.592ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:590
1542024-08-03T04:34:56.592ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:394
1552024-08-03T04:34:56.592ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:374
1562024-08-03T04:34:56.592ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:480 result = DisksManagementResult { status: [] }
1572024-08-03T04:34:56.594ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3898
1582024-08-03T04:34:56.594ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4271
1592024-08-03T04:34:56.625ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1602024-08-03T04:34:56.647ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:316
1612024-08-03T04:34:56.664ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1622024-08-03T04:34:56.669ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:383 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
1632024-08-03T04:34:56.669ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1642024-08-03T04:34:56.669ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:395 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
1652024-08-03T04:34:56.669ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1662024-08-03T04:34:56.673ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 133.99283ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "41cae800-a414-41f2-bdde-c8c6cf034896", "content-length": "124", "date": "Sat, 03 Aug 2024 04:34:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "41cae800-a414-41f2-bdde-c8c6cf034896" } file = clients/ddm-admin-client/src/lib.rs:177
1672024-08-03T04:34:56.682ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_b5d91234-7a79-49d2-a89a-3bda4b110fe1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1682024-08-03T04:34:56.706ZINFOSledAgent: successfully created encrypted zvol: name="oxi_b5d91234-7a79-49d2-a89a-3bda4b110fe1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1692024-08-03T04:34:56.706ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_b5d91234-7a79-49d2-a89a-3bda4b110fe1/swap" file = sled-agent/src/swap_device.rs:96
1702024-08-03T04:34:56.711ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:410 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
1712024-08-03T04:34:56.711ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1722024-08-03T04:34:56.711ZINFOSledAgent (BackingFs): Ensuring dataset oxi_b5d91234-7a79-49d2-a89a-3bda4b110fe1/backing/fmd file = sled-agent/src/backing_fs.rs:136
1732024-08-03T04:34:56.794ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1742024-08-03T04:34:56.808ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1752024-08-03T04:34:56.809ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 135.729433ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f0f607fa-1b0f-4d08-bcc8-2eb2879d2cc3", "content-length": "124", "date": "Sat, 03 Aug 2024 04:34:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f0f607fa-1b0f-4d08-bcc8-2eb2879d2cc3" } file = clients/ddm-admin-client/src/lib.rs:177
1762024-08-03T04:34:56.946ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-08-03T04:34:56.946ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 173.564555ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b7914197-0569-4d65-8976-98d6400c9c38", "content-length": "124", "date": "Sat, 03 Aug 2024 04:34:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b7914197-0569-4d65-8976-98d6400c9c38" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-08-03T04:34:57.014ZINFOSledAgent (BackingFs): Mounting oxi_b5d91234-7a79-49d2-a89a-3bda4b110fe1/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1792024-08-03T04:34:57.027ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1802024-08-03T04:34:57.027ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1812024-08-03T04:34:57.027ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1822024-08-03T04:34:57.027ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1832024-08-03T04:34:57.121ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-08-03T04:34:57.121ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 164.158031ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "19accc08-1745-474e-b2db-215663277854", "content-length": "124", "date": "Sat, 03 Aug 2024 04:34:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "19accc08-1745-474e-b2db-215663277854" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-08-03T04:34:57.286ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-08-03T04:34:57.287ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 288.642905ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0d6332cf-9406-47c7-8cf3-458782ab3a18", "content-length": "124", "date": "Sat, 03 Aug 2024 04:34:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0d6332cf-9406-47c7-8cf3-458782ab3a18" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-08-03T04:34:57.577ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-08-03T04:34:57.578ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 255.565099ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7c8217b5-9efb-44f6-856b-057d2c614658", "content-length": "124", "date": "Sat, 03 Aug 2024 04:34:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7c8217b5-9efb-44f6-856b-057d2c614658" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-08-03T04:34:57.742ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
1902024-08-03T04:34:57.743ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:52786 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
1912024-08-03T04:34:57.743ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
1922024-08-03T04:34:57.743ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:52786 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
1932024-08-03T04:34:57.750ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 326.739977ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
1942024-08-03T04:34:57.792ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
1952024-08-03T04:34:57.792ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
1962024-08-03T04:34:57.792ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:908 underlay_address = fd00:1122:3344:101::1
1972024-08-03T04:34:57.792ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1982024-08-03T04:34:57.793ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:12345
1992024-08-03T04:34:57.793ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:429
2002024-08-03T04:34:57.793ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2012024-08-03T04:34:57.793ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2022024-08-03T04:34:57.793ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2032024-08-03T04:34:57.793ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2042024-08-03T04:34:57.793ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
2052024-08-03T04:34:57.793ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3664
2062024-08-03T04:34:57.793ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:53890
2072024-08-03T04:34:57.793ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2082024-08-03T04:34:57.793ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2092024-08-03T04:34:57.965ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2102024-08-03T04:34:57.965ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2112024-08-03T04:34:57.965ZINFOSledAgent (RSS): No ledger in /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2122024-08-03T04:34:57.965ZINFOSledAgent (RSS): No ledger in /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2132024-08-03T04:34:57.965ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2142024-08-03T04:34:57.965ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2152024-08-03T04:34:57.970ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:601 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2162024-08-03T04:34:57.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41163
2172024-08-03T04:34:57.997ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2182024-08-03T04:34:57.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41163 req_id = aa8a25fe-40bf-41d2-ab4b-ea87a4eaf2d0 response_code = 200 uri = /inventory
2192024-08-03T04:34:58.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37787
2202024-08-03T04:34:58.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37787 req_id = fea80b19-fcba-47ef-938a-43c7ded01884 response_code = 200 uri = /sled-role
2212024-08-03T04:34:58.033ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2222024-08-03T04:34:58.033ZINFOSledAgent (RSS): Writing ledger to /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2232024-08-03T04:34:58.033ZINFOSledAgent (RSS): Writing ledger to /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2242024-08-03T04:34:58.034ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:830
2252024-08-03T04:34:58.069ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: bbd57e6f-9c98-4f70-97fb-047b756806ac, pool_id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e6d9edf0-ebf2-476e-a1a7-3f347840cfde, pool_id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 8e00d1e2-4c83-4cd3-a0cf-34752fc6f7f4, pool_id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: e740820d-3b4f-4da8-9f52-a5c7cb262635, pool_id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ae9a9308-4483-4061-8ec6-61c0b293a82c, pool_id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 7401fc94-5de8-4156-b9db-8fa78027e484, pool_id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6952c631-5647-41eb-9671-ca0fd4c032d0, pool_id: 2d57b90c-5604-40fb-87e1-361dc611bf9e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: d06348cb-48e9-42c0-b3c1-c901c36d0cc9, pool_id: 77551b64-b476-4b28-ab7c-579a041315cc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 387e44a6-be3d-4e4a-89e6-7aa3a1c8f035, pool_id: 869fe861-6756-4391-9071-05e75ac72c2e (zpool) }] } file = sled-agent/src/rack_setup/service.rs:355 sled_address = [fd00:1122:3344:101::1]:12345
2262024-08-03T04:34:58.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43999
2272024-08-03T04:34:58.069ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:842 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2282024-08-03T04:34:58.069ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: bbd57e6f-9c98-4f70-97fb-047b756806ac, pool_id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e6d9edf0-ebf2-476e-a1a7-3f347840cfde, pool_id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 8e00d1e2-4c83-4cd3-a0cf-34752fc6f7f4, pool_id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: e740820d-3b4f-4da8-9f52-a5c7cb262635, pool_id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ae9a9308-4483-4061-8ec6-61c0b293a82c, pool_id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 7401fc94-5de8-4156-b9db-8fa78027e484, pool_id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6952c631-5647-41eb-9671-ca0fd4c032d0, pool_id: 2d57b90c-5604-40fb-87e1-361dc611bf9e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: d06348cb-48e9-42c0-b3c1-c901c36d0cc9, pool_id: 77551b64-b476-4b28-ab7c-579a041315cc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 387e44a6-be3d-4e4a-89e6-7aa3a1c8f035, pool_id: 869fe861-6756-4391-9071-05e75ac72c2e (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:405
2292024-08-03T04:34:58.069ZINFOSledAgent (StorageManager): No ledger in /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2302024-08-03T04:34:58.069ZINFOSledAgent (StorageManager): No ledger in /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2312024-08-03T04:34:58.069ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:644 request = omicron_physical_disks_ensure
2322024-08-03T04:34:58.069ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:374
2332024-08-03T04:34:58.069ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:414
2342024-08-03T04:34:58.069ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
2352024-08-03T04:34:58.069ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2362024-08-03T04:34:58.164ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 749.15847ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2372024-08-03T04:34:58.171ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:360
2382024-08-03T04:34:58.171ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool)
2392024-08-03T04:34:58.973ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 726.006154ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2402024-08-03T04:34:58.973ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2412024-08-03T04:34:59.160ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }
2422024-08-03T04:34:59.334ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:348
2432024-08-03T04:34:59.334ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:350
2442024-08-03T04:34:59.334ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:354
2452024-08-03T04:34:59.334ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:356
2462024-08-03T04:34:59.334ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2472024-08-03T04:34:59.334ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2482024-08-03T04:34:59.334ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
2492024-08-03T04:34:59.701ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.635837309s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2502024-08-03T04:34:59.874ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2475
2512024-08-03T04:34:59.874ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:601 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2522024-08-03T04:34:59.874ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2693
2532024-08-03T04:34:59.874ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2345
2542024-08-03T04:34:59.874ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2392
2552024-08-03T04:34:59.874ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2774
2562024-08-03T04:34:59.874ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2816
2572024-08-03T04:34:59.876ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2582024-08-03T04:35:00.065ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2618
2592024-08-03T04:35:00.067ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2602024-08-03T04:35:00.068ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2386
2612024-08-03T04:35:00.068ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='15c8d1d1-5390-4178-83d0-3d823aff8b12'/> <propval type="astring" name="rack_id" value='bbdaff03-a88f-4e22-b963-265ac181051d'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe9a:48c0'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='efa65cdf-dd3f-49ef-9fee-7f962aef90ca'/> <propval type="astring" name="rack_id" value='bbdaff03-a88f-4e22-b963-265ac181051d'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='efa65cdf-dd3f-49ef-9fee-7f962aef90ca'/> <propval type="astring" name="rack_uuid" value='bbdaff03-a88f-4e22-b963-265ac181051d'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='efa65cdf-dd3f-49ef-9fee-7f962aef90ca'/> <propval type="astring" name="rack_uuid" value='bbdaff03-a88f-4e22-b963-265ac181051d'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2622024-08-03T04:35:00.068ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_switch
2632024-08-03T04:35:00.229ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_46278603-ed5b-4e1e-8790-ff33bffa4ceb/crypt/zone file = sled-storage/src/dataset.rs:411
2642024-08-03T04:35:00.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 30.379261ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2652024-08-03T04:35:01.402ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.639511314s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2662024-08-03T04:35:01.403ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2672024-08-03T04:35:01.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 54.933981ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2682024-08-03T04:35:02.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 204.545315ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2692024-08-03T04:35:02.083ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:601 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2702024-08-03T04:35:02.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 285.398409ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2712024-08-03T04:35:02.742ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2722024-08-03T04:35:03.469ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_46278603-ed5b-4e1e-8790-ff33bffa4ceb file = sled-storage/src/dataset.rs:496
2732024-08-03T04:35:03.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 618.977033ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2742024-08-03T04:35:03.704ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:512
2752024-08-03T04:35:03.704ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:429
2762024-08-03T04:35:03.704ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:414
2772024-08-03T04:35:03.704ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
2782024-08-03T04:35:03.704ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2792024-08-03T04:35:03.941ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:360
2802024-08-03T04:35:03.941ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool)
2812024-08-03T04:35:05.099ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }
2822024-08-03T04:35:05.340ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:348
2832024-08-03T04:35:05.340ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:350
2842024-08-03T04:35:05.340ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:354
2852024-08-03T04:35:05.340ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:356
2862024-08-03T04:35:05.340ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-08-03T04:35:05.341ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-08-03T04:35:05.341ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
2892024-08-03T04:35:05.897ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:601 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2902024-08-03T04:35:05.897ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2912024-08-03T04:35:06.633ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3922 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2922024-08-03T04:35:06.633ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3938
2932024-08-03T04:35:06.633ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:518 zone = oxz_switch
2942024-08-03T04:35:06.857ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952024-08-03T04:35:07.093ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2962024-08-03T04:35:07.093ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.84703166s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2972024-08-03T04:35:07.098ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_67739d5d-424d-405e-8a3a-6c20313bdaf6/crypt/zone file = sled-storage/src/dataset.rs:411
2982024-08-03T04:35:07.360ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:601 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
2992024-08-03T04:35:08.305ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
3002024-08-03T04:35:08.309ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
3012024-08-03T04:35:08.389ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_67739d5d-424d-405e-8a3a-6c20313bdaf6 file = sled-storage/src/dataset.rs:496
3022024-08-03T04:35:08.398ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:512
3032024-08-03T04:35:08.398ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:429
3042024-08-03T04:35:08.398ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:414
3052024-08-03T04:35:08.398ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3062024-08-03T04:35:08.398ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3072024-08-03T04:35:08.409ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:360
3082024-08-03T04:35:08.409ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 01ed0023-10bb-4905-bb62-ccce58715666 (zpool)
3092024-08-03T04:35:08.506ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }
3102024-08-03T04:35:08.514ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:348
3112024-08-03T04:35:08.514ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:350
3122024-08-03T04:35:08.514ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:354
3132024-08-03T04:35:08.514ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:356
3142024-08-03T04:35:08.514ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3152024-08-03T04:35:08.515ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3162024-08-03T04:35:08.515ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
3172024-08-03T04:35:08.550ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3182024-08-03T04:35:08.558ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_01ed0023-10bb-4905-bb62-ccce58715666/crypt/zone file = sled-storage/src/dataset.rs:411
3192024-08-03T04:35:08.681ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_01ed0023-10bb-4905-bb62-ccce58715666 file = sled-storage/src/dataset.rs:496
3202024-08-03T04:35:08.689ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:512
3212024-08-03T04:35:08.689ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:429
3222024-08-03T04:35:08.689ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:414
3232024-08-03T04:35:08.689ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3242024-08-03T04:35:08.689ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3252024-08-03T04:35:08.699ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:360
3262024-08-03T04:35:08.699ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool)
3272024-08-03T04:35:08.789ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }
3282024-08-03T04:35:08.797ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:348
3292024-08-03T04:35:08.797ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:350
3302024-08-03T04:35:08.797ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:354
3312024-08-03T04:35:08.797ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:356
3322024-08-03T04:35:08.797ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3332024-08-03T04:35:08.798ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3342024-08-03T04:35:08.798ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
3352024-08-03T04:35:08.834ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3362024-08-03T04:35:08.841ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_13d2cb16-058b-4197-b952-c7814b2cff2c/crypt/zone file = sled-storage/src/dataset.rs:411
3372024-08-03T04:35:08.958ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_13d2cb16-058b-4197-b952-c7814b2cff2c file = sled-storage/src/dataset.rs:496
3382024-08-03T04:35:08.966ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:512
3392024-08-03T04:35:08.966ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:429
3402024-08-03T04:35:08.966ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:414
3412024-08-03T04:35:08.966ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3422024-08-03T04:35:08.966ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3432024-08-03T04:35:08.976ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:360
3442024-08-03T04:35:08.976ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 38797675-2946-44e6-bde7-79f0880ee086 (zpool)
3452024-08-03T04:35:09.070ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }
3462024-08-03T04:35:09.078ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:348
3472024-08-03T04:35:09.078ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:350
3482024-08-03T04:35:09.078ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:354
3492024-08-03T04:35:09.078ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:356
3502024-08-03T04:35:09.078ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3512024-08-03T04:35:09.078ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3522024-08-03T04:35:09.078ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
3532024-08-03T04:35:09.113ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3542024-08-03T04:35:09.121ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_38797675-2946-44e6-bde7-79f0880ee086/crypt/zone file = sled-storage/src/dataset.rs:411
3552024-08-03T04:35:09.238ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_38797675-2946-44e6-bde7-79f0880ee086 file = sled-storage/src/dataset.rs:496
3562024-08-03T04:35:09.245ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:512
3572024-08-03T04:35:09.245ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:429
3582024-08-03T04:35:09.245ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:414
3592024-08-03T04:35:09.245ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3602024-08-03T04:35:09.245ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3612024-08-03T04:35:09.256ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:360
3622024-08-03T04:35:09.256ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool)
3632024-08-03T04:35:09.352ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }
3642024-08-03T04:35:09.360ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:348
3652024-08-03T04:35:09.360ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:350
3662024-08-03T04:35:09.360ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:354
3672024-08-03T04:35:09.360ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:356
3682024-08-03T04:35:09.360ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3692024-08-03T04:35:09.361ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3702024-08-03T04:35:09.361ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
3712024-08-03T04:35:09.365ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:601 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
3722024-08-03T04:35:09.365ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
3732024-08-03T04:35:09.396ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3742024-08-03T04:35:09.404ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ec22abdc-76d0-4dce-9241-6d7acac56c81/crypt/zone file = sled-storage/src/dataset.rs:411
3752024-08-03T04:35:09.526ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ec22abdc-76d0-4dce-9241-6d7acac56c81 file = sled-storage/src/dataset.rs:496
3762024-08-03T04:35:09.533ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:512
3772024-08-03T04:35:09.534ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:429
3782024-08-03T04:35:09.534ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:414
3792024-08-03T04:35:09.534ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3802024-08-03T04:35:09.534ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3812024-08-03T04:35:09.543ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:360
3822024-08-03T04:35:09.543ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 2d57b90c-5604-40fb-87e1-361dc611bf9e (zpool)
3832024-08-03T04:35:09.636ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 2d57b90c-5604-40fb-87e1-361dc611bf9e (zpool), kind: External }
3842024-08-03T04:35:09.644ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:348
3852024-08-03T04:35:09.644ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:350
3862024-08-03T04:35:09.644ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:354
3872024-08-03T04:35:09.644ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:356
3882024-08-03T04:35:09.644ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3892024-08-03T04:35:09.644ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3902024-08-03T04:35:09.644ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
3912024-08-03T04:35:09.676ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3922024-08-03T04:35:09.683ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2d57b90c-5604-40fb-87e1-361dc611bf9e/crypt/zone file = sled-storage/src/dataset.rs:411
3932024-08-03T04:35:09.796ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2d57b90c-5604-40fb-87e1-361dc611bf9e file = sled-storage/src/dataset.rs:496
3942024-08-03T04:35:09.803ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:512
3952024-08-03T04:35:09.803ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:429
3962024-08-03T04:35:09.803ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:414
3972024-08-03T04:35:09.803ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3982024-08-03T04:35:09.803ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3992024-08-03T04:35:09.813ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:360
4002024-08-03T04:35:09.813ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 77551b64-b476-4b28-ab7c-579a041315cc (zpool)
4012024-08-03T04:35:09.910ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 77551b64-b476-4b28-ab7c-579a041315cc (zpool), kind: External }
4022024-08-03T04:35:09.921ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:348
4032024-08-03T04:35:09.921ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:350
4042024-08-03T04:35:09.921ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:354
4052024-08-03T04:35:09.921ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:356
4062024-08-03T04:35:09.921ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4072024-08-03T04:35:09.921ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4082024-08-03T04:35:09.921ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
4092024-08-03T04:35:09.962ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4102024-08-03T04:35:09.970ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_77551b64-b476-4b28-ab7c-579a041315cc/crypt/zone file = sled-storage/src/dataset.rs:411
4112024-08-03T04:35:10.096ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_77551b64-b476-4b28-ab7c-579a041315cc file = sled-storage/src/dataset.rs:496
4122024-08-03T04:35:10.105ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:512
4132024-08-03T04:35:10.105ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:429
4142024-08-03T04:35:10.105ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:414
4152024-08-03T04:35:10.105ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
4162024-08-03T04:35:10.105ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4172024-08-03T04:35:10.115ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:360
4182024-08-03T04:35:10.115ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 869fe861-6756-4391-9071-05e75ac72c2e (zpool)
4192024-08-03T04:35:10.211ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 869fe861-6756-4391-9071-05e75ac72c2e (zpool), kind: External }
4202024-08-03T04:35:10.219ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:348
4212024-08-03T04:35:10.219ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:350
4222024-08-03T04:35:10.219ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:354
4232024-08-03T04:35:10.219ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:356
4242024-08-03T04:35:10.219ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4252024-08-03T04:35:10.219ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4262024-08-03T04:35:10.219ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
4272024-08-03T04:35:10.255ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4282024-08-03T04:35:10.263ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_869fe861-6756-4391-9071-05e75ac72c2e/crypt/zone file = sled-storage/src/dataset.rs:411
4292024-08-03T04:35:10.367ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
4302024-08-03T04:35:10.387ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_869fe861-6756-4391-9071-05e75ac72c2e file = sled-storage/src/dataset.rs:496
4312024-08-03T04:35:10.395ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:512
4322024-08-03T04:35:10.395ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:429
4332024-08-03T04:35:10.395ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4342024-08-03T04:35:10.396ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b5d91234-7a79-49d2-a89a-3bda4b110fe1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 16e1fbb7-6638-498f-9e1e-29640ce1133e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2d57b90c-5604-40fb-87e1-361dc611bf9e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 77551b64-b476-4b28-ab7c-579a041315cc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 869fe861-6756-4391-9071-05e75ac72c2e (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4352024-08-03T04:35:10.396ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4362024-08-03T04:35:10.396ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4372024-08-03T04:35:10.396ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4382024-08-03T04:35:10.396ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:846 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
4392024-08-03T04:35:10.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4402024-08-03T04:35:10.396ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:872 generation = Generation(1) sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
4412024-08-03T04:35:10.396ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:877 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
4422024-08-03T04:35:10.396ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:882 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
4432024-08-03T04:35:10.396ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:116 gen = Generation(1) sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
4442024-08-03T04:35:10.396ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:888 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
4452024-08-03T04:35:10.396ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:838 gen = Generation(1)
4462024-08-03T04:35:10.396ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:893 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
4472024-08-03T04:35:10.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 12327146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43999 req_id = c27e4bc7-a9d7-4891-b6d5-dbf6b7cf5be2 response_code = 200 uri = /omicron-physical-disks
4482024-08-03T04:35:10.428ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
4492024-08-03T04:35:10.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62168
4502024-08-03T04:35:10.428ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
4512024-08-03T04:35:10.428ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }
4522024-08-03T04:35:10.481ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
4532024-08-03T04:35:10.481ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4542024-08-03T04:35:10.531ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
4552024-08-03T04:35:10.531ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4562024-08-03T04:35:10.582ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4572024-08-03T04:35:10.582ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-zones.json file = common/src/ledger.rs:188
4582024-08-03T04:35:10.582ZINFOSledAgent (ServiceManager): No ledger in /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-zones.json file = common/src/ledger.rs:188
4592024-08-03T04:35:10.582ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4602024-08-03T04:35:10.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4612024-08-03T04:35:10.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4622024-08-03T04:35:10.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4632024-08-03T04:35:10.679ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7 file = illumos-utils/src/zone.rs:316
4642024-08-03T04:35:10.682ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97 file = illumos-utils/src/zone.rs:316
4652024-08-03T04:35:10.686ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8 file = illumos-utils/src/zone.rs:316
4662024-08-03T04:35:10.699ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7 file = illumos-utils/src/zone.rs:354
4672024-08-03T04:35:10.703ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97 file = illumos-utils/src/zone.rs:354
4682024-08-03T04:35:10.708ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8 file = illumos-utils/src/zone.rs:354
4692024-08-03T04:35:11.359ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:601 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
4702024-08-03T04:35:11.369ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/efa65cdf-dd3f-49ef-9fee-7f962aef90ca): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
4712024-08-03T04:35:12.144ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4722024-08-03T04:35:12.144ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4732024-08-03T04:35:12.144ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8
4742024-08-03T04:35:12.630ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4752024-08-03T04:35:13.109ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4762024-08-03T04:35:13.109ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4772024-08-03T04:35:13.109ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4782024-08-03T04:35:13.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8") failed: Property not found. retry in 67.09504ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8
4792024-08-03T04:35:13.118ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7
4802024-08-03T04:35:13.122ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97
4812024-08-03T04:35:13.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8") failed: Property not found. retry in 105.651107ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8
4822024-08-03T04:35:13.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97") failed: Property not found. retry in 41.941005ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97
4832024-08-03T04:35:13.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7") failed: Property not found. retry in 46.719287ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7
4842024-08-03T04:35:13.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97") failed: Property not found. retry in 131.310392ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97
4852024-08-03T04:35:13.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7") failed: Property not found. retry in 81.618532ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7
4862024-08-03T04:35:13.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8") failed: Property not found. retry in 193.469946ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8
4872024-08-03T04:35:13.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7") failed: Property not found. retry in 220.667ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7
4882024-08-03T04:35:13.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97") failed: Property not found. retry in 248.313173ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97
4892024-08-03T04:35:13.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8") failed: Property not found. retry in 448.421348ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8
4902024-08-03T04:35:13.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7") failed: Property not found. retry in 423.291608ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7
4912024-08-03T04:35:13.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97") failed: Property not found. retry in 401.932709ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97
4922024-08-03T04:35:14.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8") failed: Property not found. retry in 421.847334ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8
4932024-08-03T04:35:14.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7") failed: Property not found. retry in 425.688406ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7
4942024-08-03T04:35:14.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97") failed: Property not found. retry in 872.545131ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97
4952024-08-03T04:35:14.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8") failed: Property not found. retry in 1.170906974s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8
4962024-08-03T04:35:14.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7") failed: Property not found. retry in 1.199724528s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7
4972024-08-03T04:35:15.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97") failed: Property not found. retry in 1.172597099s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97
4982024-08-03T04:35:15.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8") failed: Property not found. retry in 761.946613ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8
4992024-08-03T04:35:15.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7") failed: Property not found. retry in 1.013094778s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7
5002024-08-03T04:35:16.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97") failed: Property not found. retry in 618.656061ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97
5012024-08-03T04:35:16.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8") failed: Property not found. retry in 754.894125ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8
5022024-08-03T04:35:16.452ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3946
5032024-08-03T04:35:16.452ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:3956 gateway = fd00:1122:3344:101::1
5042024-08-03T04:35:16.458ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4035
5052024-08-03T04:35:16.580ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4083
5062024-08-03T04:35:16.580ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4110
5072024-08-03T04:35:16.618ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4123
5082024-08-03T04:35:16.618ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:3987
5092024-08-03T04:35:16.672ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4029
5102024-08-03T04:35:16.672ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4090 rack_subnet = fd00:1122:3344::
5112024-08-03T04:35:16.692ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4101
5122024-08-03T04:35:16.692ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4143
5132024-08-03T04:35:16.787ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4175
5142024-08-03T04:35:16.787ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4181
5152024-08-03T04:35:16.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7") failed: Property not found. retry in 1.117200688s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7
5162024-08-03T04:35:16.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97") failed: Property not found. retry in 1.049555863s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97
5172024-08-03T04:35:16.901ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4222
5182024-08-03T04:35:16.901ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:366
5192024-08-03T04:35:16.933ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 45.042409ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:385
5202024-08-03T04:35:16.980ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 92.442726ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:385
5212024-08-03T04:35:17.073ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 222.698678ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:385
5222024-08-03T04:35:17.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8") failed: Property not found. retry in 1.312702552s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8
5232024-08-03T04:35:17.296ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 260.608356ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:385
5242024-08-03T04:35:17.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:36044
5252024-08-03T04:35:17.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:36044 req_id = 21325e66-e438-430f-8265-fdbdc641786c response_code = 200 uri = /sled-identifiers
5262024-08-03T04:35:17.559ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:414
5272024-08-03T04:35:17.592ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:675
5282024-08-03T04:35:17.592ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:713
5292024-08-03T04:35:17.592ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:716 uptime = 0
5302024-08-03T04:35:17.592ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:436
5312024-08-03T04:35:17.629ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
5322024-08-03T04:35:17.651ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
5332024-08-03T04:35:17.672ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:405
5342024-08-03T04:35:17.672ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5352024-08-03T04:35:17.672ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5362024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5372024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5382024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5392024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5402024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5412024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5422024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5432024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5442024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5452024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5462024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5472024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5482024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5492024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5502024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5512024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5522024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5532024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5542024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5552024-08-03T04:35:17.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5562024-08-03T04:35:17.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7") failed: Property not found. retry in 1.041371192s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7
5572024-08-03T04:35:17.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97") failed: Property not found. retry in 1.396410735s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97
5582024-08-03T04:35:19.340ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_internal_dns_b5b7a3c4-0da6-4740-bdbc-a057ca56eef8
5592024-08-03T04:35:19.340ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_internal_dns_13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7
5602024-08-03T04:35:19.340ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_internal_dns_2f04f6ba-6862-4851-818e-d3b61fdc5b97
5612024-08-03T04:35:19.340ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5622024-08-03T04:35:19.340ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5632024-08-03T04:35:19.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 8912619 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62168 req_id = 8681218e-dd0a-4df5-a9ba-9bd0dc890d60 response_code = 204 uri = /omicron-zones
5642024-08-03T04:35:19.342ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5652024-08-03T04:35:19.392ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5662024-08-03T04:35:19.438ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5672024-08-03T04:35:19.484ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:591
5682024-08-03T04:35:19.484ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5692024-08-03T04:35:19.516ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5702024-08-03T04:35:19.517ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5712024-08-03T04:35:19.517ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5722024-08-03T04:35:19.546ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 56ee5731-87a7-48d4-9a97-36f8568a10ba, kind: Service { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336 }, name: Name("ntp-65e7516f-cbec-4f0a-8371-7e3ccb235336"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 114])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
5732024-08-03T04:35:19.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62157
5742024-08-03T04:35:19.546ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
5752024-08-03T04:35:19.546ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }
5762024-08-03T04:35:19.568ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
5772024-08-03T04:35:19.568ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5782024-08-03T04:35:19.585ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
5792024-08-03T04:35:19.585ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5802024-08-03T04:35:19.602ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
5812024-08-03T04:35:19.602ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-zones.json file = common/src/ledger.rs:177
5822024-08-03T04:35:19.602ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-zones.json file = common/src/ledger.rs:177
5832024-08-03T04:35:19.602ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
5842024-08-03T04:35:19.613ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5852024-08-03T04:35:19.645ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5862024-08-03T04:35:19.646ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5872024-08-03T04:35:19.646ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5882024-08-03T04:35:19.674ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 222, 114]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5892024-08-03T04:35:19.674ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1210 zone_type = boundary_ntp
5902024-08-03T04:35:19.675ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
5912024-08-03T04:35:19.675ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
5922024-08-03T04:35:19.675ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
5932024-08-03T04:35:19.675ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
5942024-08-03T04:35:19.698ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336 file = illumos-utils/src/zone.rs:316
5952024-08-03T04:35:19.718ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336 file = illumos-utils/src/zone.rs:354
5962024-08-03T04:35:20.346ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5972024-08-03T04:35:20.346ZINFOSledAgent (ServiceManager): Booting oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336
5982024-08-03T04:35:20.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336") failed: Property not found. retry in 61.054939ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336
5992024-08-03T04:35:20.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336") failed: Property not found. retry in 87.654707ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336
6002024-08-03T04:35:20.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336") failed: Property not found. retry in 132.299548ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336
6012024-08-03T04:35:20.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336") failed: Property not found. retry in 518.71038ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336
6022024-08-03T04:35:21.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336") failed: Property not found. retry in 867.281919ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336
6032024-08-03T04:35:22.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336") failed: Property not found. retry in 1.289730026s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336
6042024-08-03T04:35:23.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336") failed: Property not found. retry in 764.10822ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336
6052024-08-03T04:35:24.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336") failed: Property not found. retry in 818.507346ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336
6062024-08-03T04:35:25.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336") failed: Property not found. retry in 1.254514482s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336
6072024-08-03T04:35:26.392ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336
6082024-08-03T04:35:26.392ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6092024-08-03T04:35:26.392ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6102024-08-03T04:35:26.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 6846535 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62157 req_id = 4a1832e8-ae8d-4e0b-9c59-51080ba05a1a response_code = 204 uri = /omicron-zones
6112024-08-03T04:35:26.394ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:632
6122024-08-03T04:35:26.423ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6132024-08-03T04:35:26.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47218
6142024-08-03T04:35:26.432ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3650
6152024-08-03T04:35:26.432ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:902 latency_us = 8733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47218 req_id = 5ca8fdd8-c9e3-48fc-b38b-193ce34ece0f response_code = 500 uri = /timesync
6162024-08-03T04:35:26.435ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6172024-08-03T04:35:26.530ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6182024-08-03T04:35:26.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43074
6192024-08-03T04:35:30.539ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3650
6202024-08-03T04:35:30.539ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:902 latency_us = 4009200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43074 req_id = d4f240db-b70d-4da1-8d84-8cc78397a7d2 response_code = 500 uri = /timesync
6212024-08-03T04:35:30.543ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6222024-08-03T04:35:30.738ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6232024-08-03T04:35:30.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40587
6242024-08-03T04:35:30.748ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3650
6252024-08-03T04:35:30.748ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:902 latency_us = 9534 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40587 req_id = 8fb6decd-f5fc-4bfb-9eb3-3689310be06e response_code = 500 uri = /timesync
6262024-08-03T04:35:30.751ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6272024-08-03T04:35:30.977ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6282024-08-03T04:35:30.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50636
6292024-08-03T04:35:30.985ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_65e7516f-cbec-4f0a-8371-7e3ccb235336': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3650
6302024-08-03T04:35:30.985ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:902 latency_us = 8321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50636 req_id = ff298aa2-dc00-4be3-aa96-09c6d6538a13 response_code = 500 uri = /timesync
6312024-08-03T04:35:30.987ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6322024-08-03T04:35:31.120ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6332024-08-03T04:35:31.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37322
6342024-08-03T04:35:33.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 2009432 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37322 req_id = 79cd1546-5f53-4a0e-b6f6-e8ee528b4ef1 response_code = 200 uri = /timesync
6352024-08-03T04:35:33.132ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6362024-08-03T04:35:33.132ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6372024-08-03T04:35:33.346ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6382024-08-03T04:35:33.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35388
6392024-08-03T04:35:33.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 8269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35388 req_id = 7dddb54f-5f44-4adf-a67a-f97490134d7f response_code = 200 uri = /timesync
6402024-08-03T04:35:33.358ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.003661748 } file = sled-agent/src/rack_setup/service.rs:640
6412024-08-03T04:35:33.358ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6422024-08-03T04:35:33.627ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6432024-08-03T04:35:33.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59998
6442024-08-03T04:35:33.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 19737 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59998 req_id = 3cc17bac-c0d5-41d6-b66f-de89badf20b4 response_code = 200 uri = /timesync
6452024-08-03T04:35:33.649ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2516061015, ip_addr: 149.248.11.87, stratum: 3, ref_time: 1722659733.2768624, correction: -0.001683746 } file = sled-agent/src/rack_setup/service.rs:640
6462024-08-03T04:35:33.649ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1230
6472024-08-03T04:35:33.679ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 56ee5731-87a7-48d4-9a97-36f8568a10ba, kind: Service { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336 }, name: Name("ntp-65e7516f-cbec-4f0a-8371-7e3ccb235336"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 114])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3c490926-dd47-4aac-9045-eb263318bfd2, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } } } }, OmicronZoneConfig { id: e18d20ac-51a8-4635-a3a2-d085be16d79a, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } } } }, OmicronZoneConfig { id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External } } } }, OmicronZoneConfig { id: 29112a70-71d9-49f2-9935-1337f966424c, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
6482024-08-03T04:35:33.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39538
6492024-08-03T04:35:33.679ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
6502024-08-03T04:35:33.679ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }
6512024-08-03T04:35:33.700ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
6522024-08-03T04:35:33.700ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6532024-08-03T04:35:33.719ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
6542024-08-03T04:35:33.719ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6552024-08-03T04:35:33.737ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6562024-08-03T04:35:33.737ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6572024-08-03T04:35:33.790ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6582024-08-03T04:35:33.790ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6592024-08-03T04:35:33.842ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6602024-08-03T04:35:33.842ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6612024-08-03T04:35:33.893ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6622024-08-03T04:35:33.893ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6632024-08-03T04:35:33.945ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6642024-08-03T04:35:33.945ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6652024-08-03T04:35:33.999ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
6662024-08-03T04:35:33.999ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-zones.json file = common/src/ledger.rs:177
6672024-08-03T04:35:33.999ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-zones.json file = common/src/ledger.rs:177
6682024-08-03T04:35:33.999ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
6692024-08-03T04:35:34.033ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
6702024-08-03T04:35:34.033ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
6712024-08-03T04:35:34.033ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
6722024-08-03T04:35:34.033ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
6732024-08-03T04:35:34.033ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
6742024-08-03T04:35:34.033ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48", TimeNotSynchronized), ("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8", TimeNotSynchronized), ("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2", TimeNotSynchronized), ("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c", TimeNotSynchronized), ("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a", TimeNotSynchronized)] file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:902 latency_us = 354071 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39538 req_id = 6dbd1423-0490-4656-94e2-b847471fed6d response_code = 500 uri = /omicron-zones
6752024-08-03T04:35:34.033ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6dbd1423-0490-4656-94e2-b847471fed6d", "content-length": "124", "date": "Sat, 03 Aug 2024 04:35:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6dbd1423-0490-4656-94e2-b847471fed6d" } file = sled-agent/src/rack_setup/service.rs:475 retry_after = 147.282037ms sled_address = [fd00:1122:3344:101::1]:12345
6762024-08-03T04:35:34.181ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 56ee5731-87a7-48d4-9a97-36f8568a10ba, kind: Service { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336 }, name: Name("ntp-65e7516f-cbec-4f0a-8371-7e3ccb235336"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 114])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3c490926-dd47-4aac-9045-eb263318bfd2, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } } } }, OmicronZoneConfig { id: e18d20ac-51a8-4635-a3a2-d085be16d79a, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } } } }, OmicronZoneConfig { id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External } } } }, OmicronZoneConfig { id: 29112a70-71d9-49f2-9935-1337f966424c, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
6772024-08-03T04:35:34.182ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
6782024-08-03T04:35:34.182ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }
6792024-08-03T04:35:34.200ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
6802024-08-03T04:35:34.200ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6812024-08-03T04:35:34.218ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
6822024-08-03T04:35:34.218ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6832024-08-03T04:35:34.237ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6842024-08-03T04:35:34.237ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6852024-08-03T04:35:34.255ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6862024-08-03T04:35:34.255ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6872024-08-03T04:35:34.274ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6882024-08-03T04:35:34.274ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6892024-08-03T04:35:34.292ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6902024-08-03T04:35:34.292ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6912024-08-03T04:35:34.310ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6922024-08-03T04:35:34.310ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6932024-08-03T04:35:34.328ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
6942024-08-03T04:35:34.328ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-zones.json file = common/src/ledger.rs:177
6952024-08-03T04:35:34.328ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-zones.json file = common/src/ledger.rs:177
6962024-08-03T04:35:34.329ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
6972024-08-03T04:35:34.361ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
6982024-08-03T04:35:34.361ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
6992024-08-03T04:35:34.361ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
7002024-08-03T04:35:34.361ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
7012024-08-03T04:35:34.361ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
7022024-08-03T04:35:34.362ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2", TimeNotSynchronized), ("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48", TimeNotSynchronized), ("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a", TimeNotSynchronized), ("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8", TimeNotSynchronized), ("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c", TimeNotSynchronized)] file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:902 latency_us = 180512 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39538 req_id = be69f19b-94b2-4198-a051-cc85224c48a2 response_code = 500 uri = /omicron-zones
7032024-08-03T04:35:34.362ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "be69f19b-94b2-4198-a051-cc85224c48a2", "content-length": "124", "date": "Sat, 03 Aug 2024 04:35:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "be69f19b-94b2-4198-a051-cc85224c48a2" } file = sled-agent/src/rack_setup/service.rs:475 retry_after = 178.296536ms sled_address = [fd00:1122:3344:101::1]:12345
7042024-08-03T04:35:34.541ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 56ee5731-87a7-48d4-9a97-36f8568a10ba, kind: Service { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336 }, name: Name("ntp-65e7516f-cbec-4f0a-8371-7e3ccb235336"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 114])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3c490926-dd47-4aac-9045-eb263318bfd2, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } } } }, OmicronZoneConfig { id: e18d20ac-51a8-4635-a3a2-d085be16d79a, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } } } }, OmicronZoneConfig { id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External } } } }, OmicronZoneConfig { id: 29112a70-71d9-49f2-9935-1337f966424c, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
7052024-08-03T04:35:34.541ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7062024-08-03T04:35:34.541ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }
7072024-08-03T04:35:34.563ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7082024-08-03T04:35:34.563ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7092024-08-03T04:35:34.581ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7102024-08-03T04:35:34.581ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7112024-08-03T04:35:34.598ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7122024-08-03T04:35:34.599ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7132024-08-03T04:35:34.617ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7142024-08-03T04:35:34.617ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7152024-08-03T04:35:34.635ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7162024-08-03T04:35:34.635ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7172024-08-03T04:35:34.653ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7182024-08-03T04:35:34.653ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7192024-08-03T04:35:34.671ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7202024-08-03T04:35:34.671ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7212024-08-03T04:35:34.689ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7222024-08-03T04:35:34.689ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-zones.json file = common/src/ledger.rs:177
7232024-08-03T04:35:34.689ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-zones.json file = common/src/ledger.rs:177
7242024-08-03T04:35:34.689ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7252024-08-03T04:35:34.721ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
7262024-08-03T04:35:34.721ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
7272024-08-03T04:35:34.721ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
7282024-08-03T04:35:34.721ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
7292024-08-03T04:35:34.721ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
7302024-08-03T04:35:34.721ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2", TimeNotSynchronized), ("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a", TimeNotSynchronized), ("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48", TimeNotSynchronized), ("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c", TimeNotSynchronized), ("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8", TimeNotSynchronized)] file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:902 latency_us = 180355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39538 req_id = 6b6dfac3-9c18-4bdb-b76d-81dcadb4ba21 response_code = 500 uri = /omicron-zones
7312024-08-03T04:35:34.721ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6b6dfac3-9c18-4bdb-b76d-81dcadb4ba21", "content-length": "124", "date": "Sat, 03 Aug 2024 04:35:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6b6dfac3-9c18-4bdb-b76d-81dcadb4ba21" } file = sled-agent/src/rack_setup/service.rs:475 retry_after = 83.287979ms sled_address = [fd00:1122:3344:101::1]:12345
7322024-08-03T04:35:34.806ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 56ee5731-87a7-48d4-9a97-36f8568a10ba, kind: Service { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336 }, name: Name("ntp-65e7516f-cbec-4f0a-8371-7e3ccb235336"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 114])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3c490926-dd47-4aac-9045-eb263318bfd2, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } } } }, OmicronZoneConfig { id: e18d20ac-51a8-4635-a3a2-d085be16d79a, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } } } }, OmicronZoneConfig { id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External } } } }, OmicronZoneConfig { id: 29112a70-71d9-49f2-9935-1337f966424c, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
7332024-08-03T04:35:34.807ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7342024-08-03T04:35:34.807ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }
7352024-08-03T04:35:34.826ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7362024-08-03T04:35:34.826ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7372024-08-03T04:35:34.843ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7382024-08-03T04:35:34.843ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7392024-08-03T04:35:34.861ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7402024-08-03T04:35:34.861ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7412024-08-03T04:35:34.880ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7422024-08-03T04:35:34.881ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7432024-08-03T04:35:34.899ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7442024-08-03T04:35:34.899ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7452024-08-03T04:35:34.917ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7462024-08-03T04:35:34.917ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7472024-08-03T04:35:34.935ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7482024-08-03T04:35:34.935ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7492024-08-03T04:35:34.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7502024-08-03T04:35:34.952ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-zones.json file = common/src/ledger.rs:177
7512024-08-03T04:35:34.952ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-zones.json file = common/src/ledger.rs:177
7522024-08-03T04:35:34.953ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7532024-08-03T04:35:34.984ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
7542024-08-03T04:35:34.984ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
7552024-08-03T04:35:34.984ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
7562024-08-03T04:35:34.984ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
7572024-08-03T04:35:34.984ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
7582024-08-03T04:35:34.984ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48", TimeNotSynchronized), ("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a", TimeNotSynchronized), ("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8", TimeNotSynchronized), ("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c", TimeNotSynchronized), ("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2", TimeNotSynchronized)] file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:902 latency_us = 178047 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39538 req_id = 1b41a477-cf71-4ff0-bfa3-034ed9d21de7 response_code = 500 uri = /omicron-zones
7592024-08-03T04:35:34.984ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1b41a477-cf71-4ff0-bfa3-034ed9d21de7", "content-length": "124", "date": "Sat, 03 Aug 2024 04:35:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1b41a477-cf71-4ff0-bfa3-034ed9d21de7" } file = sled-agent/src/rack_setup/service.rs:475 retry_after = 186.042657ms sled_address = [fd00:1122:3344:101::1]:12345
7602024-08-03T04:35:35.172ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 56ee5731-87a7-48d4-9a97-36f8568a10ba, kind: Service { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336 }, name: Name("ntp-65e7516f-cbec-4f0a-8371-7e3ccb235336"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 114])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3c490926-dd47-4aac-9045-eb263318bfd2, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } } } }, OmicronZoneConfig { id: e18d20ac-51a8-4635-a3a2-d085be16d79a, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } } } }, OmicronZoneConfig { id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External } } } }, OmicronZoneConfig { id: 29112a70-71d9-49f2-9935-1337f966424c, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
7612024-08-03T04:35:35.172ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7622024-08-03T04:35:35.172ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }
7632024-08-03T04:35:35.190ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7642024-08-03T04:35:35.190ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7652024-08-03T04:35:35.207ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7662024-08-03T04:35:35.207ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7672024-08-03T04:35:35.224ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7682024-08-03T04:35:35.224ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7692024-08-03T04:35:35.241ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7702024-08-03T04:35:35.241ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7712024-08-03T04:35:35.260ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7722024-08-03T04:35:35.260ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7732024-08-03T04:35:35.276ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7742024-08-03T04:35:35.276ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7752024-08-03T04:35:35.293ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7762024-08-03T04:35:35.293ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7772024-08-03T04:35:35.310ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7782024-08-03T04:35:35.310ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-zones.json file = common/src/ledger.rs:177
7792024-08-03T04:35:35.310ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-zones.json file = common/src/ledger.rs:177
7802024-08-03T04:35:35.310ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7812024-08-03T04:35:35.342ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
7822024-08-03T04:35:35.342ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
7832024-08-03T04:35:35.342ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
7842024-08-03T04:35:35.342ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
7852024-08-03T04:35:35.342ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3065 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
7862024-08-03T04:35:35.342ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48", TimeNotSynchronized), ("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2", TimeNotSynchronized), ("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a", TimeNotSynchronized), ("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8", TimeNotSynchronized), ("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c", TimeNotSynchronized)] file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:902 latency_us = 169985 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39538 req_id = db283fdd-b7cb-4cc3-b720-93ceb7ddfa16 response_code = 500 uri = /omicron-zones
7872024-08-03T04:35:35.342ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "db283fdd-b7cb-4cc3-b720-93ceb7ddfa16", "content-length": "124", "date": "Sat, 03 Aug 2024 04:35:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "db283fdd-b7cb-4cc3-b720-93ceb7ddfa16" } file = sled-agent/src/rack_setup/service.rs:475 retry_after = 281.144086ms sled_address = [fd00:1122:3344:101::1]:12345
7882024-08-03T04:35:35.624ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 56ee5731-87a7-48d4-9a97-36f8568a10ba, kind: Service { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336 }, name: Name("ntp-65e7516f-cbec-4f0a-8371-7e3ccb235336"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 114])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3c490926-dd47-4aac-9045-eb263318bfd2, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } } } }, OmicronZoneConfig { id: e18d20ac-51a8-4635-a3a2-d085be16d79a, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } } } }, OmicronZoneConfig { id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External } } } }, OmicronZoneConfig { id: 29112a70-71d9-49f2-9935-1337f966424c, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
7892024-08-03T04:35:35.625ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7902024-08-03T04:35:35.625ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }
7912024-08-03T04:35:35.645ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7922024-08-03T04:35:35.645ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7932024-08-03T04:35:35.663ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7942024-08-03T04:35:35.663ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7952024-08-03T04:35:35.681ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7962024-08-03T04:35:35.681ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7972024-08-03T04:35:35.698ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7982024-08-03T04:35:35.699ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7992024-08-03T04:35:35.716ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
8002024-08-03T04:35:35.716ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8012024-08-03T04:35:35.733ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
8022024-08-03T04:35:35.733ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8032024-08-03T04:35:35.751ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
8042024-08-03T04:35:35.751ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8052024-08-03T04:35:35.768ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8062024-08-03T04:35:35.768ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-zones.json file = common/src/ledger.rs:177
8072024-08-03T04:35:35.768ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-zones.json file = common/src/ledger.rs:177
8082024-08-03T04:35:35.768ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8092024-08-03T04:35:35.848ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8102024-08-03T04:35:35.848ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8112024-08-03T04:35:35.848ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8122024-08-03T04:35:35.848ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8132024-08-03T04:35:35.848ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8142024-08-03T04:35:35.941ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8 file = illumos-utils/src/zone.rs:316
8152024-08-03T04:35:35.945ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a file = illumos-utils/src/zone.rs:316
8162024-08-03T04:35:35.949ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c file = illumos-utils/src/zone.rs:316
8172024-08-03T04:35:35.954ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48 file = illumos-utils/src/zone.rs:316
8182024-08-03T04:35:35.958ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2 file = illumos-utils/src/zone.rs:316
8192024-08-03T04:35:35.963ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8 file = illumos-utils/src/zone.rs:354
8202024-08-03T04:35:35.968ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a file = illumos-utils/src/zone.rs:354
8212024-08-03T04:35:35.972ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c file = illumos-utils/src/zone.rs:354
8222024-08-03T04:35:35.976ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48 file = illumos-utils/src/zone.rs:354
8232024-08-03T04:35:35.981ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2 file = illumos-utils/src/zone.rs:354
8242024-08-03T04:35:36.976ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 232.041332ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
8252024-08-03T04:35:38.949ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b56fa7d9-a830-4d71-a79c-d70ad4e47fd8'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8262024-08-03T04:35:38.949ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8272024-08-03T04:35:38.968ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='29112a70-71d9-49f2-9935-1337f966424c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8282024-08-03T04:35:38.968ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8292024-08-03T04:35:38.985ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e2402da0-fcd5-4b14-a3df-b7371daf6f48'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8302024-08-03T04:35:38.986ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8312024-08-03T04:35:38.994ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3c490926-dd47-4aac-9045-eb263318bfd2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8322024-08-03T04:35:38.994ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8332024-08-03T04:35:39.042ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e18d20ac-51a8-4635-a3a2-d085be16d79a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8342024-08-03T04:35:39.042ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8352024-08-03T04:35:39.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 68.113074ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8362024-08-03T04:35:39.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 62.857914ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8372024-08-03T04:35:39.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 52.991298ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8382024-08-03T04:35:39.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 38.945645ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8392024-08-03T04:35:39.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 137.792272ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8402024-08-03T04:35:39.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 59.164027ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8412024-08-03T04:35:39.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 56.45497ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8422024-08-03T04:35:39.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 96.585002ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8432024-08-03T04:35:40.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 134.107997ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8442024-08-03T04:35:40.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 218.267474ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8452024-08-03T04:35:40.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 218.477079ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8462024-08-03T04:35:40.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 83.575931ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8472024-08-03T04:35:40.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 136.721492ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8482024-08-03T04:35:40.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 104.557289ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8492024-08-03T04:35:40.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 352.87994ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8502024-08-03T04:35:41.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 321.681012ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8512024-08-03T04:35:42.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 147.640608ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8522024-08-03T04:35:42.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 564.969086ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8532024-08-03T04:35:42.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 226.339236ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8542024-08-03T04:35:42.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 923.402202ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8552024-08-03T04:35:42.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 865.975166ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8562024-08-03T04:35:42.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 211.458999ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8572024-08-03T04:35:42.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 845.918783ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8582024-08-03T04:35:42.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.058894985s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8592024-08-03T04:35:42.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 956.100009ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8602024-08-03T04:35:43.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 545.047512ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8612024-08-03T04:35:43.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 948.865215ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8622024-08-03T04:35:43.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 1.298869498s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8632024-08-03T04:35:43.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.107068794s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8642024-08-03T04:35:43.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 669.563875ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8652024-08-03T04:35:43.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 1.435442536s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8662024-08-03T04:35:44.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 1.082299372s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8672024-08-03T04:35:44.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 887.037326ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8682024-08-03T04:35:44.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 1.230956436s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8692024-08-03T04:35:44.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 681.131328ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8702024-08-03T04:35:45.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 934.836019ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8712024-08-03T04:35:45.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 1.248038133s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8722024-08-03T04:35:45.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 1.269175856s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8732024-08-03T04:35:45.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 521.531704ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8742024-08-03T04:35:45.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 710.580388ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8752024-08-03T04:35:45.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 923.44562ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8762024-08-03T04:35:46.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 539.805699ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8772024-08-03T04:35:46.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 896.633115ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8782024-08-03T04:35:46.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 1.145775264s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8792024-08-03T04:35:46.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 690.216207ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8802024-08-03T04:35:46.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 1.271070474s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8812024-08-03T04:35:46.670ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44777
8822024-08-03T04:35:46.671ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 130 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44777 req_id = a650ade8-0a77-419e-b147-1bc373e32587 response_code = 200 uri = /baseboard
8832024-08-03T04:35:46.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.133806763s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8842024-08-03T04:35:47.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 1.472825178s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8852024-08-03T04:35:47.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 951.985688ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8862024-08-03T04:35:47.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 875.622613ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8872024-08-03T04:35:47.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 1.404024069s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8882024-08-03T04:35:47.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.143508534s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8892024-08-03T04:35:48.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 684.273943ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8902024-08-03T04:35:48.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 1.261623036s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8912024-08-03T04:35:48.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 761.792861ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8922024-08-03T04:35:49.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 971.931399ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8932024-08-03T04:35:49.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 957.707852ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8942024-08-03T04:35:49.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 1.321946332s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
8952024-08-03T04:35:49.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 1.180003893s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
8962024-08-03T04:35:49.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8") failed: Property not found. retry in 706.064068ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
8972024-08-03T04:35:49.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 1.117334729s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
8982024-08-03T04:35:50.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.0113806s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
8992024-08-03T04:35:50.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 1.236451444s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9002024-08-03T04:35:50.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 945.62215ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
9012024-08-03T04:35:51.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.280448334s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
9022024-08-03T04:35:51.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 1.479884793s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
9032024-08-03T04:35:51.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 643.136491ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
9042024-08-03T04:35:51.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 643.710043ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9052024-08-03T04:35:52.245ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 397.073217ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
9062024-08-03T04:35:52.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 592.591248ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
9072024-08-03T04:35:52.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.291333849s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
9082024-08-03T04:35:52.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 561.775687ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9092024-08-03T04:35:52.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 1.387002347s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
9102024-08-03T04:35:52.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 613.28022ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
9112024-08-03T04:35:53.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 869.293021ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9122024-08-03T04:35:53.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 989.286354ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
9132024-08-03T04:35:53.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.080431529s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
9142024-08-03T04:35:54.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 505.049721ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
9152024-08-03T04:35:54.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 1.354085818s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9162024-08-03T04:35:54.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 746.402362ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
9172024-08-03T04:35:54.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 1.015762291s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
9182024-08-03T04:35:54.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.269006036s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
9192024-08-03T04:35:55.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 1.48643648s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
9202024-08-03T04:35:55.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 1.398658284s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9212024-08-03T04:35:55.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 1.243658482s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
9222024-08-03T04:35:56.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 647.873756ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
9232024-08-03T04:35:56.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.069051707s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
9242024-08-03T04:35:56.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 1.440796724s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
9252024-08-03T04:35:56.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 1.241168841s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9262024-08-03T04:35:56.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 1.336947372s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
9272024-08-03T04:35:57.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.093418303s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
9282024-08-03T04:35:58.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 571.33559ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9292024-08-03T04:35:58.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 1.441850075s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
9302024-08-03T04:35:58.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 1.17991536s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
9312024-08-03T04:35:58.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 1.144733663s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9322024-08-03T04:35:58.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 1.002711512s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
9332024-08-03T04:35:59.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 729.662675ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
9342024-08-03T04:35:59.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48") failed: Property not found. retry in 1.335459041s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
9352024-08-03T04:35:59.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 579.936382ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9362024-08-03T04:35:59.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a") failed: Property not found. retry in 731.810249ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
9372024-08-03T04:36:00.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2") failed: Property not found. retry in 578.084446ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
9382024-08-03T04:36:00.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c") failed: Property not found. retry in 925.758658ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9392024-08-03T04:36:01.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_cockroachdb_3c490926-dd47-4aac-9045-eb263318bfd2
9402024-08-03T04:36:01.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_cockroachdb_b56fa7d9-a830-4d71-a79c-d70ad4e47fd8
9412024-08-03T04:36:01.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_cockroachdb_e18d20ac-51a8-4635-a3a2-d085be16d79a
9422024-08-03T04:36:01.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_cockroachdb_29112a70-71d9-49f2-9935-1337f966424c
9432024-08-03T04:36:01.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_cockroachdb_e2402da0-fcd5-4b14-a3df-b7371daf6f48
9442024-08-03T04:36:01.310ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9452024-08-03T04:36:01.310ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9462024-08-03T04:36:01.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 25686305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39538 req_id = 90f10e2a-2c92-4c22-90bf-25caa5cfd36c response_code = 204 uri = /omicron-zones
9472024-08-03T04:36:01.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53114
9482024-08-03T04:36:01.373ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3484
9492024-08-03T04:36:16.272ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3502
9502024-08-03T04:36:24.388ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3525
9512024-08-03T04:36:24.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 23045313 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53114 req_id = 45c51094-b976-46df-b3cc-c0a239d5cc28 response_code = 204 uri = /cockroachdb
9522024-08-03T04:36:24.389ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50583
9532024-08-03T04:36:24.390ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 966 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50583 req_id = 0a09f963-35a0-4d32-9388-92ff6ebb9a0e response_code = 200 uri = /baseboard
9542024-08-03T04:36:24.394ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 629.848124ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
9552024-08-03T04:36:24.424ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 56ee5731-87a7-48d4-9a97-36f8568a10ba, kind: Service { id: 65e7516f-cbec-4f0a-8371-7e3ccb235336 }, name: Name("ntp-65e7516f-cbec-4f0a-8371-7e3ccb235336"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 114])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3c490926-dd47-4aac-9045-eb263318bfd2, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } } } }, OmicronZoneConfig { id: e18d20ac-51a8-4635-a3a2-d085be16d79a, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } } } }, OmicronZoneConfig { id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External } } } }, OmicronZoneConfig { id: 29112a70-71d9-49f2-9935-1337f966424c, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3ae46f76-c564-4aa0-92cc-6b2618c98bfb, underlay_address: fd00:1122:3344:101::8, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 40700bba-c501-4ab6-824f-e22cd70b9e0b, kind: Service { id: 3ae46f76-c564-4aa0-92cc-6b2618c98bfb }, name: Name("external-dns-3ae46f76-c564-4aa0-92cc-6b2618c98bfb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 97ec20c6-2686-4dd7-b53b-c077ae6d0eb8, underlay_address: fd00:1122:3344:101::9, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 3295b879-d7a7-43b9-974f-693c44ae1caf, kind: Service { id: 97ec20c6-2686-4dd7-b53b-c077ae6d0eb8 }, name: Name("external-dns-97ec20c6-2686-4dd7-b53b-c077ae6d0eb8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 33])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: adde72dd-c12b-4912-bc90-d32e0e191860, underlay_address: fd00:1122:3344:101::a, filesystem_pool: Some(ZpoolName { id: 869fe861-6756-4391-9071-05e75ac72c2e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 0955e115-6d30-4f1c-ac2d-483a53fbde57, kind: Service { id: adde72dd-c12b-4912-bc90-d32e0e191860 }, name: Name("nexus-adde72dd-c12b-4912-bc90-d32e0e191860"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 224a7dd7-29d8-4168-b114-549087c4dbdd, underlay_address: fd00:1122:3344:101::b, filesystem_pool: Some(ZpoolName { id: 869fe861-6756-4391-9071-05e75ac72c2e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 7bca5b15-b5be-4740-b204-2cf8307b0f09, kind: Service { id: 224a7dd7-29d8-4168-b114-549087c4dbdd }, name: Name("nexus-224a7dd7-29d8-4168-b114-549087c4dbdd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 17664e32-68d9-4b36-8d33-e7dfbc57f33e, underlay_address: fd00:1122:3344:101::c, filesystem_pool: Some(ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: dd08eb98-9af5-4618-9458-5a9592c90353, kind: Service { id: 17664e32-68d9-4b36-8d33-e7dfbc57f33e }, name: Name("nexus-17664e32-68d9-4b36-8d33-e7dfbc57f33e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 8908ca80-7dc7-4b9e-b801-fdf7ed13d106, underlay_address: fd00:1122:3344:101::d, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: bbe794dd-eb2c-469b-9b4b-b8bd6a304e92, underlay_address: fd00:1122:3344:101::e, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } } } }, OmicronZoneConfig { id: 662a9949-b2d3-4f0f-9015-c19cb7b0c60d, underlay_address: fd00:1122:3344:101::f, filesystem_pool: Some(ZpoolName { id: 869fe861-6756-4391-9071-05e75ac72c2e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: b2cd7d76-f41b-426d-9c79-ed17dc365226, underlay_address: fd00:1122:3344:101::10, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 2df9d2ab-5b0c-4941-b977-a3e783666f56, underlay_address: fd00:1122:3344:101::11, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: da146f3b-000c-43cc-a406-902d803ea05e, underlay_address: fd00:1122:3344:101::12, filesystem_pool: Some(ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External } } } }, OmicronZoneConfig { id: 9e95e816-1059-48f2-9222-cffa285e8e40, underlay_address: fd00:1122:3344:101::13, filesystem_pool: Some(ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: cf172c04-bb64-4fe0-ad28-4a368170622a, underlay_address: fd00:1122:3344:101::14, filesystem_pool: Some(ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9bccaa04-7823-446d-b7e3-c1f06fc42f00, underlay_address: fd00:1122:3344:101::15, filesystem_pool: Some(ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External } } } }, OmicronZoneConfig { id: 2e19b761-114f-4ded-bc11-5cdf09369189, underlay_address: fd00:1122:3344:101::16, filesystem_pool: Some(ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External } } } }, OmicronZoneConfig { id: f0815c0b-cefb-431f-a626-9491fa8439dc, underlay_address: fd00:1122:3344:101::17, filesystem_pool: Some(ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External } } } }, OmicronZoneConfig { id: a3a39c6e-e40a-48d9-9e57-299f9d472923, underlay_address: fd00:1122:3344:101::18, filesystem_pool: Some(ZpoolName { id: 2d57b90c-5604-40fb-87e1-361dc611bf9e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d57b90c-5604-40fb-87e1-361dc611bf9e (zpool), kind: External } } } }, OmicronZoneConfig { id: aced5c8b-f432-4dc3-a044-23ce965d7240, underlay_address: fd00:1122:3344:101::19, filesystem_pool: Some(ZpoolName { id: 77551b64-b476-4b28-ab7c-579a041315cc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 77551b64-b476-4b28-ab7c-579a041315cc (zpool), kind: External } } } }, OmicronZoneConfig { id: 2975dcbc-e1db-4b8d-a51b-98f501c26c48, underlay_address: fd00:1122:3344:101::1a, filesystem_pool: Some(ZpoolName { id: 869fe861-6756-4391-9071-05e75ac72c2e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 869fe861-6756-4391-9071-05e75ac72c2e (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
9562024-08-03T04:36:24.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34111
9572024-08-03T04:36:24.424ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
9582024-08-03T04:36:24.424ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b5b7a3c4-0da6-4740-bdbc-a057ca56eef8, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: InternalDns }, responder: ... }
9592024-08-03T04:36:24.452ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
9602024-08-03T04:36:24.452ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 13681bd3-6f1e-46eb-86f7-b8c7fd0c8cc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9612024-08-03T04:36:24.472ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
9622024-08-03T04:36:24.472ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2f04f6ba-6862-4851-818e-d3b61fdc5b97, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9632024-08-03T04:36:24.493ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
9642024-08-03T04:36:24.493ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 3c490926-dd47-4aac-9045-eb263318bfd2, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9652024-08-03T04:36:24.512ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
9662024-08-03T04:36:24.512ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e18d20ac-51a8-4635-a3a2-d085be16d79a, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9672024-08-03T04:36:24.530ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
9682024-08-03T04:36:24.530ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: e2402da0-fcd5-4b14-a3df-b7371daf6f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9692024-08-03T04:36:24.550ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
9702024-08-03T04:36:24.550ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: b56fa7d9-a830-4d71-a79c-d70ad4e47fd8, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9712024-08-03T04:36:24.569ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
9722024-08-03T04:36:24.569ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 29112a70-71d9-49f2-9935-1337f966424c, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9732024-08-03T04:36:24.589ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3ae46f76-c564-4aa0-92cc-6b2618c98bfb, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
9742024-08-03T04:36:24.589ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 3ae46f76-c564-4aa0-92cc-6b2618c98bfb, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9752024-08-03T04:36:24.663ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 97ec20c6-2686-4dd7-b53b-c077ae6d0eb8, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
9762024-08-03T04:36:24.663ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 97ec20c6-2686-4dd7-b53b-c077ae6d0eb8, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9772024-08-03T04:36:24.739ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bbe794dd-eb2c-469b-9b4b-b8bd6a304e92, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:405
9782024-08-03T04:36:24.739ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: bbe794dd-eb2c-469b-9b4b-b8bd6a304e92, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9792024-08-03T04:36:24.838ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: da146f3b-000c-43cc-a406-902d803ea05e, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9802024-08-03T04:36:24.838ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: da146f3b-000c-43cc-a406-902d803ea05e, dataset_name: DatasetName { pool_name: ZpoolName { id: 46278603-ed5b-4e1e-8790-ff33bffa4ceb (zpool), kind: External }, kind: Crucible }, responder: ... }
9812024-08-03T04:36:24.926ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9e95e816-1059-48f2-9222-cffa285e8e40, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9822024-08-03T04:36:24.926ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 9e95e816-1059-48f2-9222-cffa285e8e40, dataset_name: DatasetName { pool_name: ZpoolName { id: 67739d5d-424d-405e-8a3a-6c20313bdaf6 (zpool), kind: External }, kind: Crucible }, responder: ... }
9832024-08-03T04:36:25.008ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cf172c04-bb64-4fe0-ad28-4a368170622a, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9842024-08-03T04:36:25.008ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: cf172c04-bb64-4fe0-ad28-4a368170622a, dataset_name: DatasetName { pool_name: ZpoolName { id: 01ed0023-10bb-4905-bb62-ccce58715666 (zpool), kind: External }, kind: Crucible }, responder: ... }
9852024-08-03T04:36:25.087ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9bccaa04-7823-446d-b7e3-c1f06fc42f00, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9862024-08-03T04:36:25.087ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 9bccaa04-7823-446d-b7e3-c1f06fc42f00, dataset_name: DatasetName { pool_name: ZpoolName { id: 13d2cb16-058b-4197-b952-c7814b2cff2c (zpool), kind: External }, kind: Crucible }, responder: ... }
9872024-08-03T04:36:25.166ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2e19b761-114f-4ded-bc11-5cdf09369189, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9882024-08-03T04:36:25.166ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2e19b761-114f-4ded-bc11-5cdf09369189, dataset_name: DatasetName { pool_name: ZpoolName { id: 38797675-2946-44e6-bde7-79f0880ee086 (zpool), kind: External }, kind: Crucible }, responder: ... }
9892024-08-03T04:36:25.246ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f0815c0b-cefb-431f-a626-9491fa8439dc, dataset_name: DatasetName { pool_name: ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9902024-08-03T04:36:25.246ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: f0815c0b-cefb-431f-a626-9491fa8439dc, dataset_name: DatasetName { pool_name: ZpoolName { id: ec22abdc-76d0-4dce-9241-6d7acac56c81 (zpool), kind: External }, kind: Crucible }, responder: ... }
9912024-08-03T04:36:25.320ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a3a39c6e-e40a-48d9-9e57-299f9d472923, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d57b90c-5604-40fb-87e1-361dc611bf9e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9922024-08-03T04:36:25.320ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: a3a39c6e-e40a-48d9-9e57-299f9d472923, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d57b90c-5604-40fb-87e1-361dc611bf9e (zpool), kind: External }, kind: Crucible }, responder: ... }
9932024-08-03T04:36:25.400ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aced5c8b-f432-4dc3-a044-23ce965d7240, dataset_name: DatasetName { pool_name: ZpoolName { id: 77551b64-b476-4b28-ab7c-579a041315cc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9942024-08-03T04:36:25.400ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: aced5c8b-f432-4dc3-a044-23ce965d7240, dataset_name: DatasetName { pool_name: ZpoolName { id: 77551b64-b476-4b28-ab7c-579a041315cc (zpool), kind: External }, kind: Crucible }, responder: ... }
9952024-08-03T04:36:25.478ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2975dcbc-e1db-4b8d-a51b-98f501c26c48, dataset_name: DatasetName { pool_name: ZpoolName { id: 869fe861-6756-4391-9071-05e75ac72c2e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9962024-08-03T04:36:25.478ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2975dcbc-e1db-4b8d-a51b-98f501c26c48, dataset_name: DatasetName { pool_name: ZpoolName { id: 869fe861-6756-4391-9071-05e75ac72c2e (zpool), kind: External }, kind: Crucible }, responder: ... }
9972024-08-03T04:36:25.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9982024-08-03T04:36:25.561ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-zones.json file = common/src/ledger.rs:177
9992024-08-03T04:36:25.561ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-zones.json file = common/src/ledger.rs:177
10002024-08-03T04:36:25.562ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10012024-08-03T04:36:25.659ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
10022024-08-03T04:36:25.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10032024-08-03T04:36:25.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10042024-08-03T04:36:25.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10052024-08-03T04:36:25.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10062024-08-03T04:36:25.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10072024-08-03T04:36:25.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10082024-08-03T04:36:25.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10092024-08-03T04:36:25.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10102024-08-03T04:36:25.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10112024-08-03T04:36:25.946ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
10122024-08-03T04:36:25.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10132024-08-03T04:36:25.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10142024-08-03T04:36:25.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10152024-08-03T04:36:25.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10162024-08-03T04:36:25.969ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
10172024-08-03T04:36:25.969ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10182024-08-03T04:36:25.971ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
10192024-08-03T04:36:25.982ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
10202024-08-03T04:36:25.983ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d file = illumos-utils/src/zone.rs:316
10212024-08-03T04:36:25.988ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189 file = illumos-utils/src/zone.rs:316
10222024-08-03T04:36:25.993ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e file = illumos-utils/src/zone.rs:316
10232024-08-03T04:36:25.998ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc file = illumos-utils/src/zone.rs:316
10242024-08-03T04:36:26.003ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923 file = illumos-utils/src/zone.rs:316
10252024-08-03T04:36:26.008ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92 file = illumos-utils/src/zone.rs:316
10262024-08-03T04:36:26.013ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226 file = illumos-utils/src/zone.rs:316
10272024-08-03T04:36:26.018ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106 file = illumos-utils/src/zone.rs:316
10282024-08-03T04:36:26.023ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00 file = illumos-utils/src/zone.rs:316
10292024-08-03T04:36:26.128ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d file = illumos-utils/src/zone.rs:354
10302024-08-03T04:36:26.132ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189 file = illumos-utils/src/zone.rs:354
10312024-08-03T04:36:26.137ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e file = illumos-utils/src/zone.rs:354
10322024-08-03T04:36:26.141ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc file = illumos-utils/src/zone.rs:354
10332024-08-03T04:36:26.146ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923 file = illumos-utils/src/zone.rs:354
10342024-08-03T04:36:26.151ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92 file = illumos-utils/src/zone.rs:354
10352024-08-03T04:36:26.155ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226 file = illumos-utils/src/zone.rs:354
10362024-08-03T04:36:26.160ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106 file = illumos-utils/src/zone.rs:354
10372024-08-03T04:36:26.165ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00 file = illumos-utils/src/zone.rs:354
10382024-08-03T04:36:26.170ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240 file = illumos-utils/src/zone.rs:316
10392024-08-03T04:36:26.175ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56 file = illumos-utils/src/zone.rs:316
10402024-08-03T04:36:26.180ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48 file = illumos-utils/src/zone.rs:316
10412024-08-03T04:36:26.185ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40 file = illumos-utils/src/zone.rs:316
10422024-08-03T04:36:26.192ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a file = illumos-utils/src/zone.rs:316
10432024-08-03T04:36:26.199ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240 file = illumos-utils/src/zone.rs:354
10442024-08-03T04:36:26.205ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56 file = illumos-utils/src/zone.rs:354
10452024-08-03T04:36:26.211ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48 file = illumos-utils/src/zone.rs:354
10462024-08-03T04:36:26.217ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40 file = illumos-utils/src/zone.rs:354
10472024-08-03T04:36:26.223ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a file = illumos-utils/src/zone.rs:354
10482024-08-03T04:36:26.269ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
10492024-08-03T04:36:26.332ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
10502024-08-03T04:36:26.415ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
10512024-08-03T04:36:26.530ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
10522024-08-03T04:36:26.604ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
10532024-08-03T04:36:26.606ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10542024-08-03T04:36:26.606ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10552024-08-03T04:36:26.659ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 216, 226]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10562024-08-03T04:36:26.659ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1210 zone_type = nexus
10572024-08-03T04:36:26.661ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10582024-08-03T04:36:26.661ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10592024-08-03T04:36:26.716ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 133, 132]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10602024-08-03T04:36:26.716ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1210 zone_type = nexus
10612024-08-03T04:36:26.720ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10622024-08-03T04:36:26.720ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10632024-08-03T04:36:26.776ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 148, 33]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10642024-08-03T04:36:26.776ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1210 zone_type = external_dns
10652024-08-03T04:36:26.776ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
10662024-08-03T04:36:26.776ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
10672024-08-03T04:36:26.777ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
10682024-08-03T04:36:26.777ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
10692024-08-03T04:36:26.779ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10702024-08-03T04:36:26.779ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10712024-08-03T04:36:26.833ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 175, 116]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10722024-08-03T04:36:26.833ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1210 zone_type = external_dns
10732024-08-03T04:36:26.835ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10742024-08-03T04:36:26.835ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10752024-08-03T04:36:26.887ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 174, 232]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10762024-08-03T04:36:26.887ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1210 zone_type = nexus
10772024-08-03T04:36:26.887ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
10782024-08-03T04:36:26.889ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
10792024-08-03T04:36:26.892ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10802024-08-03T04:36:26.892ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10812024-08-03T04:36:27.001ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
10822024-08-03T04:36:27.001ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
10832024-08-03T04:36:27.001ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e file = illumos-utils/src/zone.rs:316
10842024-08-03T04:36:27.018ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
10852024-08-03T04:36:27.018ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
10862024-08-03T04:36:27.018ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
10872024-08-03T04:36:27.018ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
10882024-08-03T04:36:27.018ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
10892024-08-03T04:36:27.021ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10902024-08-03T04:36:27.021ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
10912024-08-03T04:36:27.026ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
10922024-08-03T04:36:27.029ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10932024-08-03T04:36:27.029ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10942024-08-03T04:36:27.080ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e file = illumos-utils/src/zone.rs:354
10952024-08-03T04:36:27.092ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd file = illumos-utils/src/zone.rs:316
10962024-08-03T04:36:27.411ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8 file = illumos-utils/src/zone.rs:316
10972024-08-03T04:36:27.432ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd file = illumos-utils/src/zone.rs:354
10982024-08-03T04:36:27.949ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb file = illumos-utils/src/zone.rs:316
10992024-08-03T04:36:27.958ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860 file = illumos-utils/src/zone.rs:316
11002024-08-03T04:36:27.966ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8 file = illumos-utils/src/zone.rs:354
11012024-08-03T04:36:27.988ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb file = illumos-utils/src/zone.rs:354
11022024-08-03T04:36:28.019ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860 file = illumos-utils/src/zone.rs:354
11032024-08-03T04:36:30.114ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11042024-08-03T04:36:30.115ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
11052024-08-03T04:36:30.191ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_01ed0023-10bb-4905-bb62-ccce58715666/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dd04fe07-d786-49fe-8dfc-f2f6799f0b25'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11062024-08-03T04:36:30.191ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
11072024-08-03T04:36:30.285ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_13d2cb16-058b-4197-b952-c7814b2cff2c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ed1e8a49-db5f-4805-ab12-2e1ec3a89bf4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11082024-08-03T04:36:30.285ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
11092024-08-03T04:36:30.295ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2d57b90c-5604-40fb-87e1-361dc611bf9e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='66ea15c2-319c-4644-894c-e046c9792f3f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11102024-08-03T04:36:30.295ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
11112024-08-03T04:36:30.547ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_869fe861-6756-4391-9071-05e75ac72c2e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d0ddef58-6c95-465d-90c9-e102a55b1d9e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11122024-08-03T04:36:30.547ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
11132024-08-03T04:36:30.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 35.598828ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
11142024-08-03T04:36:30.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 60.826451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
11152024-08-03T04:36:30.645ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_67739d5d-424d-405e-8a3a-6c20313bdaf6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1ea65789-35cc-48b1-925d-47d3153dd22d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11162024-08-03T04:36:30.645ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
11172024-08-03T04:36:30.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 94.138285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
11182024-08-03T04:36:30.675ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_38797675-2946-44e6-bde7-79f0880ee086/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7eafabfd-fc37-403e-b032-ace08994732d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11192024-08-03T04:36:30.675ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ec22abdc-76d0-4dce-9241-6d7acac56c81/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d30c7b16-3411-4784-916f-f3e0dc5ef139'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11202024-08-03T04:36:30.676ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_77551b64-b476-4b28-ab7c-579a041315cc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9b4f9478-5010-4296-a773-97a79fbd2282'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11212024-08-03T04:36:30.676ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
11222024-08-03T04:36:30.712ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
11232024-08-03T04:36:30.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 41.137749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
11242024-08-03T04:36:30.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 73.178728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
11252024-08-03T04:36:30.837ZINFOSledAgent (ServiceManager): Booting oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
11262024-08-03T04:36:31.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 128.243988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
11272024-08-03T04:36:31.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 60.255709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
11282024-08-03T04:36:31.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 133.030603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
11292024-08-03T04:36:31.173ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='8908ca80-7dc7-4b9e-b801-fdf7ed13d106'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11302024-08-03T04:36:33.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 120.036293ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
11312024-08-03T04:36:33.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 69.313538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
11322024-08-03T04:36:33.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 66.113993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
11332024-08-03T04:36:33.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 299.24343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
11342024-08-03T04:36:33.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 289.925601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
11352024-08-03T04:36:33.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 36.756461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
11362024-08-03T04:36:33.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 139.709939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
11372024-08-03T04:36:33.973ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11382024-08-03T04:36:33.974ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
11392024-08-03T04:36:34.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 170.63827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
11402024-08-03T04:36:34.228ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11412024-08-03T04:36:34.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 146.414589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
11422024-08-03T04:36:34.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 75.449336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
11432024-08-03T04:36:34.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 830.288179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
11442024-08-03T04:36:34.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 284.011958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
11452024-08-03T04:36:34.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 141.374568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
11462024-08-03T04:36:34.643ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_46278603-ed5b-4e1e-8790-ff33bffa4ceb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ca8b0c54-6f89-49c7-885e-7e7b17e726f1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11472024-08-03T04:36:34.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 26.529572ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
11482024-08-03T04:36:34.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 216.88738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
11492024-08-03T04:36:34.669ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
11502024-08-03T04:36:34.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 248.907165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
11512024-08-03T04:36:34.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 26.548374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
11522024-08-03T04:36:34.729ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
11532024-08-03T04:36:34.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 121.594056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
11542024-08-03T04:36:34.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 198.251425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
11552024-08-03T04:36:34.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 195.668695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
11562024-08-03T04:36:34.886ZINFOSledAgent (ServiceManager): Booting oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
11572024-08-03T04:36:34.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 110.507865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
11582024-08-03T04:36:34.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 894.085002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
11592024-08-03T04:36:35.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 33.620875ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
11602024-08-03T04:36:35.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 1.147789525s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
11612024-08-03T04:36:35.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 101.773279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
11622024-08-03T04:36:36.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 415.135159ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
11632024-08-03T04:36:36.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 436.932522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
11642024-08-03T04:36:36.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 637.570541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
11652024-08-03T04:36:36.222ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11662024-08-03T04:36:36.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 795.200249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
11672024-08-03T04:36:36.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 527.36228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
11682024-08-03T04:36:36.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 288.567724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
11692024-08-03T04:36:36.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 722.000248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
11702024-08-03T04:36:36.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 126.551033ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
11712024-08-03T04:36:36.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 105.508665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
11722024-08-03T04:36:36.311ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
11732024-08-03T04:36:36.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 57.101061ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
11742024-08-03T04:36:36.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 580.528077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
11752024-08-03T04:36:36.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 151.163836ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
11762024-08-03T04:36:36.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 128.623925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
11772024-08-03T04:36:36.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 441.776813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
11782024-08-03T04:36:36.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 73.855458ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
11792024-08-03T04:36:36.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 572.511737ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
11802024-08-03T04:36:36.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 429.447191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
11812024-08-03T04:36:36.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 276.715521ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
11822024-08-03T04:36:36.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 724.80071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
11832024-08-03T04:36:36.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 681.926153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
11842024-08-03T04:36:36.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 113.445836ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
11852024-08-03T04:36:36.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 659.727449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
11862024-08-03T04:36:36.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 210.916224ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
11872024-08-03T04:36:36.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 912.502135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
11882024-08-03T04:36:36.881ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11892024-08-03T04:36:36.881ZINFOSledAgent (ServiceManager): Booting oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
11902024-08-03T04:36:36.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 29.477413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
11912024-08-03T04:36:36.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 391.360552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
11922024-08-03T04:36:36.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 93.556745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
11932024-08-03T04:36:36.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 29.537738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
11942024-08-03T04:36:37.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 681.133131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
11952024-08-03T04:36:37.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 124.86086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
11962024-08-03T04:36:37.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 1.118872195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
11972024-08-03T04:36:37.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 1.058098988s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
11982024-08-03T04:36:37.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 163.704868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
11992024-08-03T04:36:37.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 974.21054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
12002024-08-03T04:36:37.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 1.244944501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
12012024-08-03T04:36:37.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 249.773715ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
12022024-08-03T04:36:37.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 502.620226ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
12032024-08-03T04:36:37.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 211.016917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
12042024-08-03T04:36:37.271ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12052024-08-03T04:36:37.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 28.566118ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
12062024-08-03T04:36:37.290ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
12072024-08-03T04:36:37.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 69.199767ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
12082024-08-03T04:36:37.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 324.817953ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
12092024-08-03T04:36:37.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 786.087073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
12102024-08-03T04:36:37.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 166.662856ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
12112024-08-03T04:36:37.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 1.384790096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
12122024-08-03T04:36:37.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 1.482687597s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
12132024-08-03T04:36:37.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 1.20688308s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
12142024-08-03T04:36:37.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 433.892606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
12152024-08-03T04:36:37.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 691.946391ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
12162024-08-03T04:36:37.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 442.663836ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
12172024-08-03T04:36:37.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 56.809923ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
12182024-08-03T04:36:37.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 1.118649286s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
12192024-08-03T04:36:37.721ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12202024-08-03T04:36:37.721ZINFOSledAgent (ServiceManager): Booting oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
12212024-08-03T04:36:37.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 681.820148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
12222024-08-03T04:36:37.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 757.121087ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
12232024-08-03T04:36:37.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 917.392401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
12242024-08-03T04:36:37.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 75.668925ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
12252024-08-03T04:36:37.862ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12262024-08-03T04:36:37.862ZINFOSledAgent (ServiceManager): Booting oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
12272024-08-03T04:36:37.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 272.499045ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
12282024-08-03T04:36:37.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 792.139347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
12292024-08-03T04:36:38.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 44.631223ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
12302024-08-03T04:36:38.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 130.979112ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
12312024-08-03T04:36:38.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 725.392709ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
12322024-08-03T04:36:38.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 38.096669ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
12332024-08-03T04:36:38.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 569.749695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
12342024-08-03T04:36:38.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 68.094319ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
12352024-08-03T04:36:38.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 559.928199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
12362024-08-03T04:36:38.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 1.055824619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
12372024-08-03T04:36:38.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 1.151214439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
12382024-08-03T04:36:38.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 156.854237ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
12392024-08-03T04:36:38.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 536.255891ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
12402024-08-03T04:36:38.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 122.27179ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
12412024-08-03T04:36:38.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 1.253611102s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
12422024-08-03T04:36:38.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 1.44900793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
12432024-08-03T04:36:38.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 1.494813264s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
12442024-08-03T04:36:38.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 944.956595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
12452024-08-03T04:36:38.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 558.925677ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
12462024-08-03T04:36:38.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 483.913927ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
12472024-08-03T04:36:38.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 1.292416922s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
12482024-08-03T04:36:38.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 1.385051181s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
12492024-08-03T04:36:38.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 799.262738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
12502024-08-03T04:36:38.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 1.40518738s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
12512024-08-03T04:36:38.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 879.358879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
12522024-08-03T04:36:38.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 716.738007ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
12532024-08-03T04:36:38.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 894.068216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
12542024-08-03T04:36:38.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 1.002924595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
12552024-08-03T04:36:38.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 868.074532ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
12562024-08-03T04:36:38.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 833.778212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
12572024-08-03T04:36:39.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 936.220138ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
12582024-08-03T04:36:39.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 680.135947ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
12592024-08-03T04:36:39.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 783.28393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
12602024-08-03T04:36:39.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 510.276606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
12612024-08-03T04:36:39.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 1.156192933s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
12622024-08-03T04:36:39.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 541.654185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
12632024-08-03T04:36:39.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 868.054837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
12642024-08-03T04:36:39.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 855.887915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
12652024-08-03T04:36:39.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 1.399106971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
12662024-08-03T04:36:39.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 1.216181903s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
12672024-08-03T04:36:39.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 921.891713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
12682024-08-03T04:36:39.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 866.475272ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
12692024-08-03T04:36:39.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 807.408927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
12702024-08-03T04:36:39.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 963.120338ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
12712024-08-03T04:36:40.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 1.098759513s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
12722024-08-03T04:36:40.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 504.361792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
12732024-08-03T04:36:40.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 653.31203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
12742024-08-03T04:36:40.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 1.059986775s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
12752024-08-03T04:36:40.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 1.157448403s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
12762024-08-03T04:36:40.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 1.388726421s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
12772024-08-03T04:36:40.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 785.964262ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
12782024-08-03T04:36:40.211ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.733346728s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
12792024-08-03T04:36:40.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 1.070288923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
12802024-08-03T04:36:40.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 1.404376019s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
12812024-08-03T04:36:40.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 762.485633ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
12822024-08-03T04:36:40.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 1.053229108s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
12832024-08-03T04:36:40.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 1.177043368s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
12842024-08-03T04:36:40.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 588.802456ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
12852024-08-03T04:36:40.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 1.045113284s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
12862024-08-03T04:36:40.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 1.45855507s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
12872024-08-03T04:36:40.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 1.107783637s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
12882024-08-03T04:36:40.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 795.472883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
12892024-08-03T04:36:40.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 1.441010791s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
12902024-08-03T04:36:41.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 1.295423287s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
12912024-08-03T04:36:41.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 520.863298ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
12922024-08-03T04:36:41.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 788.797063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
12932024-08-03T04:36:41.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 1.068772788s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
12942024-08-03T04:36:41.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 872.877702ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
12952024-08-03T04:36:41.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 1.092214911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
12962024-08-03T04:36:41.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 1.108755948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
12972024-08-03T04:36:41.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 1.060676246s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
12982024-08-03T04:36:41.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 714.022008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
12992024-08-03T04:36:41.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 765.891084ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
13002024-08-03T04:36:41.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 1.294755993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
13012024-08-03T04:36:41.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 745.41014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
13022024-08-03T04:36:41.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 1.173528254s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
13032024-08-03T04:36:41.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 877.43874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
13042024-08-03T04:36:41.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 642.554678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
13052024-08-03T04:36:41.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 1.325837149s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
13062024-08-03T04:36:41.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 601.011041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
13072024-08-03T04:36:41.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 1.216255605s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
13082024-08-03T04:36:42.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 999.865186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
13092024-08-03T04:36:42.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 778.612785ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
13102024-08-03T04:36:42.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 1.361132258s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
13112024-08-03T04:36:42.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 563.943556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
13122024-08-03T04:36:42.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 901.445868ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
13132024-08-03T04:36:42.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 1.373801697s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
13142024-08-03T04:36:42.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 1.07141299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
13152024-08-03T04:36:42.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 996.123802ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
13162024-08-03T04:36:42.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 1.050169166s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
13172024-08-03T04:36:42.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 772.122702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
13182024-08-03T04:36:42.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 597.433243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
13192024-08-03T04:36:42.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 626.301179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
13202024-08-03T04:36:42.498ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13212024-08-03T04:36:42.498ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92 zone file = illumos-utils/src/running_zone.rs:472 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
13222024-08-03T04:36:42.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 1.366981794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
13232024-08-03T04:36:42.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 1.391953493s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
13242024-08-03T04:36:42.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 33.659164ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
13252024-08-03T04:36:42.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 588.765602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
13262024-08-03T04:36:42.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 758.757912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
13272024-08-03T04:36:43.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 137.505535ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
13282024-08-03T04:36:43.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 635.35957ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
13292024-08-03T04:36:43.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 543.624144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
13302024-08-03T04:36:43.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 1.172702159s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
13312024-08-03T04:36:43.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 1.336960882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
13322024-08-03T04:36:43.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 686.437658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
13332024-08-03T04:36:43.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 508.367156ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
13342024-08-03T04:36:43.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 289.10611ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
13352024-08-03T04:36:43.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 653.083766ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
13362024-08-03T04:36:43.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 1.087933407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
13372024-08-03T04:36:43.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 869.628833ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
13382024-08-03T04:36:43.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 824.36459ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
13392024-08-03T04:36:43.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 791.306143ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
13402024-08-03T04:36:43.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 1.012135923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
13412024-08-03T04:36:43.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 512.594396ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
13422024-08-03T04:36:43.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 1.054311793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
13432024-08-03T04:36:43.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 969.768325ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
13442024-08-03T04:36:43.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 520.832411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
13452024-08-03T04:36:43.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 1.451407991s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
13462024-08-03T04:36:43.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 1.120477986s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
13472024-08-03T04:36:43.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 1.112759851s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
13482024-08-03T04:36:43.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 1.091783464s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
13492024-08-03T04:36:43.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 926.262195ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
13502024-08-03T04:36:43.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 1.211608202s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
13512024-08-03T04:36:43.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 649.558056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
13522024-08-03T04:36:43.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 1.08394171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
13532024-08-03T04:36:44.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 867.872943ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
13542024-08-03T04:36:44.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 1.126340196s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
13552024-08-03T04:36:44.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 1.301529496s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
13562024-08-03T04:36:44.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 969.880387ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
13572024-08-03T04:36:44.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 920.661541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
13582024-08-03T04:36:44.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 1.104413047s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
13592024-08-03T04:36:44.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 1.418179381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
13602024-08-03T04:36:44.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 878.564963ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
13612024-08-03T04:36:44.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 709.042848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
13622024-08-03T04:36:44.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 1.012776275s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
13632024-08-03T04:36:44.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 729.417549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
13642024-08-03T04:36:44.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 1.060072332s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
13652024-08-03T04:36:44.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 995.124269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
13662024-08-03T04:36:44.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 875.044542ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
13672024-08-03T04:36:44.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 553.778285ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
13682024-08-03T04:36:44.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 976.857079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
13692024-08-03T04:36:44.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 931.973974ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
13702024-08-03T04:36:45.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 1.353108298s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
13712024-08-03T04:36:45.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 593.190639ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
13722024-08-03T04:36:45.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 1.066406203s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
13732024-08-03T04:36:45.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 545.599052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
13742024-08-03T04:36:45.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 1.306368s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
13752024-08-03T04:36:45.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 524.080911ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
13762024-08-03T04:36:45.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 696.818723ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
13772024-08-03T04:36:45.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 666.968812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
13782024-08-03T04:36:45.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 666.382945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
13792024-08-03T04:36:45.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 592.769983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
13802024-08-03T04:36:45.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 1.371566461s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
13812024-08-03T04:36:45.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 1.192565613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
13822024-08-03T04:36:45.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 712.399068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
13832024-08-03T04:36:45.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 1.259158253s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
13842024-08-03T04:36:45.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 953.739014ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
13852024-08-03T04:36:45.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 714.500482ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
13862024-08-03T04:36:45.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 1.166339572s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
13872024-08-03T04:36:45.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 1.067309308s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
13882024-08-03T04:36:45.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 1.447063105s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
13892024-08-03T04:36:45.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 1.304544557s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
13902024-08-03T04:36:45.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 1.382743008s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
13912024-08-03T04:36:45.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 1.390527917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
13922024-08-03T04:36:45.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 1.446682933s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
13932024-08-03T04:36:46.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 1.080726245s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
13942024-08-03T04:36:46.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 1.065991002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
13952024-08-03T04:36:46.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 676.156271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
13962024-08-03T04:36:46.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 933.04679ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
13972024-08-03T04:36:46.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 548.346764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
13982024-08-03T04:36:46.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 964.911266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
13992024-08-03T04:36:46.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 1.455175782s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
14002024-08-03T04:36:46.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 810.401743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
14012024-08-03T04:36:46.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 1.384679288s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
14022024-08-03T04:36:46.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 1.077496698s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
14032024-08-03T04:36:46.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 1.181021947s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
14042024-08-03T04:36:46.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 1.204178679s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
14052024-08-03T04:36:46.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 810.954427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
14062024-08-03T04:36:46.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 1.307186398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
14072024-08-03T04:36:46.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 966.125211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
14082024-08-03T04:36:46.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 608.493927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
14092024-08-03T04:36:47.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 1.150097096s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
14102024-08-03T04:36:47.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 1.244667121s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
14112024-08-03T04:36:47.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 1.105979951s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
14122024-08-03T04:36:47.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 587.99889ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
14132024-08-03T04:36:47.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 1.122563182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
14142024-08-03T04:36:47.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 634.006026ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
14152024-08-03T04:36:47.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 548.079304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
14162024-08-03T04:36:47.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 793.012442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
14172024-08-03T04:36:47.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 1.030206544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
14182024-08-03T04:36:47.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 1.483481037s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
14192024-08-03T04:36:47.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 923.693172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
14202024-08-03T04:36:47.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 543.062217ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
14212024-08-03T04:36:47.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 683.493188ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
14222024-08-03T04:36:47.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 707.070911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
14232024-08-03T04:36:47.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 1.157408014s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
14242024-08-03T04:36:47.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 912.278299ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
14252024-08-03T04:36:47.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00") failed: Property not found. retry in 928.804514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
14262024-08-03T04:36:47.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 1.105873024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
14272024-08-03T04:36:47.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 1.123831114s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
14282024-08-03T04:36:48.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 747.516552ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
14292024-08-03T04:36:48.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 662.485336ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
14302024-08-03T04:36:48.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 764.119058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
14312024-08-03T04:36:48.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 1.399826963s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
14322024-08-03T04:36:48.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 1.426104226s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
14332024-08-03T04:36:48.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 988.521453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
14342024-08-03T04:36:48.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 617.407796ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
14352024-08-03T04:36:48.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 504.309999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
14362024-08-03T04:36:48.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 1.436955975s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
14372024-08-03T04:36:48.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 1.118421475s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
14382024-08-03T04:36:48.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 1.1762298s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
14392024-08-03T04:36:48.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 1.250468345s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
14402024-08-03T04:36:48.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923") failed: Property not found. retry in 549.286592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
14412024-08-03T04:36:48.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 1.078234754s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
14422024-08-03T04:36:48.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 743.896303ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
14432024-08-03T04:36:48.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 1.155580908s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
14442024-08-03T04:36:48.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 1.065151295s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
14452024-08-03T04:36:48.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 870.340752ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
14462024-08-03T04:36:48.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 662.361835ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
14472024-08-03T04:36:48.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 596.780118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
14482024-08-03T04:36:48.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 712.628862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
14492024-08-03T04:36:49.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d") failed: Property not found. retry in 762.897166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
14502024-08-03T04:36:49.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 1.110034523s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
14512024-08-03T04:36:49.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 767.67636ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
14522024-08-03T04:36:49.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8") failed: Property not found. retry in 1.111090109s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
14532024-08-03T04:36:49.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 925.189212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
14542024-08-03T04:36:49.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 828.170597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
14552024-08-03T04:36:49.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 823.97922ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
14562024-08-03T04:36:49.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48") failed: Property not found. retry in 1.423148381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
14572024-08-03T04:36:49.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 1.009402494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
14582024-08-03T04:36:49.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 818.29417ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
14592024-08-03T04:36:49.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 1.155753734s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
14602024-08-03T04:36:49.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 1.139569719s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
14612024-08-03T04:36:49.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 615.317749ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
14622024-08-03T04:36:49.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 1.215035354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
14632024-08-03T04:36:49.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 848.109031ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
14642024-08-03T04:36:49.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc") failed: Property not found. retry in 1.228144376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
14652024-08-03T04:36:49.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 978.129019ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
14662024-08-03T04:36:50.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a") failed: Property not found. retry in 1.167440721s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
14672024-08-03T04:36:50.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106") failed: Property not found. retry in 1.474668086s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
14682024-08-03T04:36:50.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd") failed: Property not found. retry in 1.325383891s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
14692024-08-03T04:36:50.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40") failed: Property not found. retry in 620.400483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
14702024-08-03T04:36:50.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860") failed: Property not found. retry in 1.197567478s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
14712024-08-03T04:36:50.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 628.717395ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
14722024-08-03T04:36:50.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189") failed: Property not found. retry in 981.624013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
14732024-08-03T04:36:50.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e") failed: Property not found. retry in 1.302496923s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
14742024-08-03T04:36:50.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 550.016311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
14752024-08-03T04:36:50.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226") failed: Property not found. retry in 901.901995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
14762024-08-03T04:36:50.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240") failed: Property not found. retry in 1.155041752s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
14772024-08-03T04:36:50.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 1.234478747s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
14782024-08-03T04:36:51.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56") failed: Property not found. retry in 959.14838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
14792024-08-03T04:36:51.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb") failed: Property not found. retry in 1.086989685s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
14802024-08-03T04:36:51.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e") failed: Property not found. retry in 743.236445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
14812024-08-03T04:36:51.452ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.792004518s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
14822024-08-03T04:36:52.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 1.461991665s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
14832024-08-03T04:36:53.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 1.014296208s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
14842024-08-03T04:36:54.537ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44895
14852024-08-03T04:36:54.553ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 13862 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44895 req_id = 4f5849d0-c63f-4967-a130-1f1d9e93bd85 response_code = 200 uri = /baseboard
14862024-08-03T04:36:55.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 1.462061584s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
14872024-08-03T04:36:55.302ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.172507282s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
14882024-08-03T04:36:56.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92") failed: Property not found. retry in 606.360149ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
14892024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_nexus_17664e32-68d9-4b36-8d33-e7dfbc57f33e
14902024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_pantry_662a9949-b2d3-4f0f-9015-c19cb7b0c60d
14912024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_2e19b761-114f-4ded-bc11-5cdf09369189
14922024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_da146f3b-000c-43cc-a406-902d803ea05e
14932024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_f0815c0b-cefb-431f-a626-9491fa8439dc
14942024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_a3a39c6e-e40a-48d9-9e57-299f9d472923
14952024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_clickhouse_bbe794dd-eb2c-469b-9b4b-b8bd6a304e92
14962024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_pantry_b2cd7d76-f41b-426d-9c79-ed17dc365226
14972024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_oximeter_8908ca80-7dc7-4b9e-b801-fdf7ed13d106
14982024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_9bccaa04-7823-446d-b7e3-c1f06fc42f00
14992024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_aced5c8b-f432-4dc3-a044-23ce965d7240
15002024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_pantry_2df9d2ab-5b0c-4941-b977-a3e783666f56
15012024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_2975dcbc-e1db-4b8d-a51b-98f501c26c48
15022024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_9e95e816-1059-48f2-9222-cffa285e8e40
15032024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_nexus_224a7dd7-29d8-4168-b114-549087c4dbdd
15042024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_crucible_cf172c04-bb64-4fe0-ad28-4a368170622a
15052024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_external_dns_3ae46f76-c564-4aa0-92cc-6b2618c98bfb
15062024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_nexus_adde72dd-c12b-4912-bc90-d32e0e191860
15072024-08-03T04:36:57.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3061 zone = oxz_external_dns_97ec20c6-2686-4dd7-b53b-c077ae6d0eb8
15082024-08-03T04:36:57.117ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15092024-08-03T04:36:57.127ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15102024-08-03T04:36:57.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 32706704 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34111 req_id = 8d299d31-da74-4e0c-9bb7-cb1fb3dbd216 response_code = 204 uri = /omicron-zones
15112024-08-03T04:36:57.166ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1250
15122024-08-03T04:36:57.166ZINFOSledAgent (RSS): Writing ledger to /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15132024-08-03T04:36:57.167ZINFOSledAgent (RSS): Writing ledger to /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15142024-08-03T04:36:57.178ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:687
15152024-08-03T04:36:57.186ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:700
15162024-08-03T04:36:57.218ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:831
15172024-08-03T04:36:57.224ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15182024-08-03T04:36:57.355ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15192024-08-03T04:36:57.503ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15202024-08-03T04:36:57.680ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15212024-08-03T04:36:57.903ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15222024-08-03T04:36:58.025ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15232024-08-03T04:36:58.198ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15242024-08-03T04:36:58.537ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15252024-08-03T04:36:58.761ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15262024-08-03T04:36:59.297ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15272024-08-03T04:36:59.549ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 12.78367031s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
15282024-08-03T04:36:59.866ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15292024-08-03T04:37:00.272ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15302024-08-03T04:37:01.015ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15312024-08-03T04:37:01.527ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15322024-08-03T04:37:02.490ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15332024-08-03T04:37:04.014ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/bbdaff03-a88f-4e22-b963-265ac181051d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15342024-08-03T04:37:05.947ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "72beaff4-ae6f-4b7d-91c2-4399ed5e11e1", "content-length": "173", "date": "Sat, 03 Aug 2024 04:37:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"bbdaff03-a88f-4e22-b963-265ac181051d\"", request_id: "72beaff4-ae6f-4b7d-91c2-4399ed5e11e1" } file = sled-agent/src/rack_setup/service.rs:893
15352024-08-03T04:37:09.724ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "92241e3e-648e-4e50-8659-cfb63892d2b6", "content-length": "173", "date": "Sat, 03 Aug 2024 04:37:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"efa65cdf-dd3f-49ef-9fee-7f962aef90ca\"", request_id: "92241e3e-648e-4e50-8659-cfb63892d2b6" } file = sled-agent/src/rack_setup/service.rs:893
15362024-08-03T04:37:13.088ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ad20dd5f-053b-4e57-85f9-0741c8b232a4", "content-length": "173", "date": "Sat, 03 Aug 2024 04:37:12 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"efa65cdf-dd3f-49ef-9fee-7f962aef90ca\"", request_id: "ad20dd5f-053b-4e57-85f9-0741c8b232a4" } file = sled-agent/src/rack_setup/service.rs:893
15372024-08-03T04:37:16.368ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b6c062cf-f529-43fc-b959-223d4cd1b1cc", "content-length": "173", "date": "Sat, 03 Aug 2024 04:37:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"efa65cdf-dd3f-49ef-9fee-7f962aef90ca\"", request_id: "b6c062cf-f529-43fc-b959-223d4cd1b1cc" } file = sled-agent/src/rack_setup/service.rs:893
15382024-08-03T04:37:19.578ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "49cce0db-4560-46df-ba4a-82ca329b143e", "content-length": "173", "date": "Sat, 03 Aug 2024 04:37:19 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"efa65cdf-dd3f-49ef-9fee-7f962aef90ca\"", request_id: "49cce0db-4560-46df-ba4a-82ca329b143e" } file = sled-agent/src/rack_setup/service.rs:893
15392024-08-03T04:37:24.620ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35694
15402024-08-03T04:37:24.621ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35694 req_id = 2717ea06-d095-4097-85ce-6506051b0945 response_code = 200 uri = /baseboard
15412024-08-03T04:37:25.547ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2054d4ab-3efd-4a9a-80b3-fd5b680e3f01", "content-length": "173", "date": "Sat, 03 Aug 2024 04:37:25 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"efa65cdf-dd3f-49ef-9fee-7f962aef90ca\"", request_id: "2054d4ab-3efd-4a9a-80b3-fd5b680e3f01" } file = sled-agent/src/rack_setup/service.rs:893
15422024-08-03T04:37:30.417ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "353330b3-e8e7-41f6-952a-67254dd1c854", "content-length": "173", "date": "Sat, 03 Aug 2024 04:37:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"efa65cdf-dd3f-49ef-9fee-7f962aef90ca\"", request_id: "353330b3-e8e7-41f6-952a-67254dd1c854" } file = sled-agent/src/rack_setup/service.rs:893
15432024-08-03T04:37:34.432ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c71c0caa-ad61-4d59-b0cf-bbe68f0b4a52", "content-length": "173", "date": "Sat, 03 Aug 2024 04:37:34 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"efa65cdf-dd3f-49ef-9fee-7f962aef90ca\"", request_id: "c71c0caa-ad61-4d59-b0cf-bbe68f0b4a52" } file = sled-agent/src/rack_setup/service.rs:893
15442024-08-03T04:37:37.457ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:574 new_generation = 1 old_generation = 1 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
15452024-08-03T04:37:37.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57868
15462024-08-03T04:37:37.576ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
15472024-08-03T04:37:37.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 104466 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57868 req_id = 42dc6a41-9488-49d1-a478-cf29f94bd89d response_code = 200 uri = /inventory
15482024-08-03T04:37:37.676ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
15492024-08-03T04:37:37.677ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-zones.json file = common/src/ledger.rs:177
15502024-08-03T04:37:37.679ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-zones.json file = common/src/ledger.rs:177
15512024-08-03T04:37:37.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 4380 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57868 req_id = 216708e9-24f8-4cd2-b491-bb1c3c5a6fe1 response_code = 200 uri = /omicron-zones
15522024-08-03T04:37:37.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48930
15532024-08-03T04:37:37.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48930 req_id = 5bdcde60-839e-4bdb-9304-ce1080b7cac5 response_code = 200 uri = /vpc-routes
15542024-08-03T04:37:37.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52611
15552024-08-03T04:37:37.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 2624 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52611 req_id = 55c562ee-63d8-437f-8118-8c6c72649307 response_code = 200 uri = /v2p
15562024-08-03T04:37:37.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 2906 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48930 req_id = 610328d1-2df7-4784-affb-279f750a6396 response_code = 204 uri = /vpc-routes
15572024-08-03T04:37:38.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62485
15582024-08-03T04:37:38.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62485 req_id = f03bbf00-f65e-4aca-9da0-84df41ec5280 response_code = 200 uri = /vpc-routes
15592024-08-03T04:37:38.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62485 req_id = c0832c71-7977-4e49-82d8-237134da6036 response_code = 204 uri = /vpc-routes
15602024-08-03T04:37:38.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59939
15612024-08-03T04:37:38.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59939 req_id = dc4915af-c70a-4c0d-aed5-d19430273413 response_code = 200 uri = /vpc-routes
15622024-08-03T04:37:38.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59939 req_id = 18c41b4c-5828-4892-b009-cf5bae575f5a response_code = 204 uri = /vpc-routes
15632024-08-03T04:37:38.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62676
15642024-08-03T04:37:38.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62676 req_id = c03c619f-89d3-4334-9df2-d4e44bdaa732 response_code = 200 uri = /v2p
15652024-08-03T04:37:38.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42165
15662024-08-03T04:37:38.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42165 req_id = 7892c74a-f6d5-47ed-8acd-ae6dff55315b response_code = 200 uri = /v2p
15672024-08-03T04:37:42.512ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:52786 remote_addr = [fd00:1122:3344:101::d]:33429 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca
15682024-08-03T04:37:42.518ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 6193 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = 04d89dbe-6107-43ae-8bc6-592442c0dc02 response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
15692024-08-03T04:37:43.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34523
15702024-08-03T04:37:43.486ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3295b879-d7a7-43b9-974f-693c44ae1caf, kind: Service { id: 97ec20c6-2686-4dd7-b53b-c077ae6d0eb8 }, name: Name("external-dns-97ec20c6-2686-4dd7-b53b-c077ae6d0eb8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 33])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40700bba-c501-4ab6-824f-e22cd70b9e0b, kind: Service { id: 3ae46f76-c564-4aa0-92cc-6b2618c98bfb }, name: Name("external-dns-3ae46f76-c564-4aa0-92cc-6b2618c98bfb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0955e115-6d30-4f1c-ac2d-483a53fbde57, kind: Service { id: adde72dd-c12b-4912-bc90-d32e0e191860 }, name: Name("nexus-adde72dd-c12b-4912-bc90-d32e0e191860"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bca5b15-b5be-4740-b204-2cf8307b0f09, kind: Service { id: 224a7dd7-29d8-4168-b114-549087c4dbdd }, name: Name("nexus-224a7dd7-29d8-4168-b114-549087c4dbdd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd08eb98-9af5-4618-9458-5a9592c90353, kind: Service { id: 17664e32-68d9-4b36-8d33-e7dfbc57f33e }, name: Name("nexus-17664e32-68d9-4b36-8d33-e7dfbc57f33e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15712024-08-03T04:37:43.486ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15722024-08-03T04:37:43.486ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15732024-08-03T04:37:43.486ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15742024-08-03T04:37:43.486ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
15752024-08-03T04:37:43.486ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15762024-08-03T04:37:43.486ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15772024-08-03T04:37:43.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 3091 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34523 req_id = 5fc73530-89f9-4c95-ab41-45e234d027ff response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15782024-08-03T04:37:43.488ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:903
15792024-08-03T04:37:43.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58582
15802024-08-03T04:37:43.663ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
15812024-08-03T04:37:43.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 94412 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58582 req_id = 26635749-8ee7-43d8-bd84-788a1cdd160b response_code = 200 uri = /inventory
15822024-08-03T04:37:43.759ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
15832024-08-03T04:37:43.759ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/config/omicron-zones.json file = common/src/ledger.rs:177
15842024-08-03T04:37:43.760ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/config/omicron-zones.json file = common/src/ledger.rs:177
15852024-08-03T04:37:43.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 3405 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58582 req_id = 5c9b1211-4ae8-496a-9284-cc6be5bf8de4 response_code = 200 uri = /omicron-zones
15862024-08-03T04:37:45.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42377
15872024-08-03T04:37:45.278ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3295b879-d7a7-43b9-974f-693c44ae1caf, kind: Service { id: 97ec20c6-2686-4dd7-b53b-c077ae6d0eb8 }, name: Name("external-dns-97ec20c6-2686-4dd7-b53b-c077ae6d0eb8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 33])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40700bba-c501-4ab6-824f-e22cd70b9e0b, kind: Service { id: 3ae46f76-c564-4aa0-92cc-6b2618c98bfb }, name: Name("external-dns-3ae46f76-c564-4aa0-92cc-6b2618c98bfb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0955e115-6d30-4f1c-ac2d-483a53fbde57, kind: Service { id: adde72dd-c12b-4912-bc90-d32e0e191860 }, name: Name("nexus-adde72dd-c12b-4912-bc90-d32e0e191860"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bca5b15-b5be-4740-b204-2cf8307b0f09, kind: Service { id: 224a7dd7-29d8-4168-b114-549087c4dbdd }, name: Name("nexus-224a7dd7-29d8-4168-b114-549087c4dbdd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd08eb98-9af5-4618-9458-5a9592c90353, kind: Service { id: 17664e32-68d9-4b36-8d33-e7dfbc57f33e }, name: Name("nexus-17664e32-68d9-4b36-8d33-e7dfbc57f33e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15882024-08-03T04:37:45.278ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15892024-08-03T04:37:45.278ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15902024-08-03T04:37:45.278ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15912024-08-03T04:37:45.278ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
15922024-08-03T04:37:45.278ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15932024-08-03T04:37:45.278ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15942024-08-03T04:37:45.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42377 req_id = 1466112d-e1e7-4dd4-a34e-3ac2cb87a58e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15952024-08-03T04:37:45.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49579
15962024-08-03T04:37:45.286ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3295b879-d7a7-43b9-974f-693c44ae1caf, kind: Service { id: 97ec20c6-2686-4dd7-b53b-c077ae6d0eb8 }, name: Name("external-dns-97ec20c6-2686-4dd7-b53b-c077ae6d0eb8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 33])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40700bba-c501-4ab6-824f-e22cd70b9e0b, kind: Service { id: 3ae46f76-c564-4aa0-92cc-6b2618c98bfb }, name: Name("external-dns-3ae46f76-c564-4aa0-92cc-6b2618c98bfb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0955e115-6d30-4f1c-ac2d-483a53fbde57, kind: Service { id: adde72dd-c12b-4912-bc90-d32e0e191860 }, name: Name("nexus-adde72dd-c12b-4912-bc90-d32e0e191860"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bca5b15-b5be-4740-b204-2cf8307b0f09, kind: Service { id: 224a7dd7-29d8-4168-b114-549087c4dbdd }, name: Name("nexus-224a7dd7-29d8-4168-b114-549087c4dbdd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd08eb98-9af5-4618-9458-5a9592c90353, kind: Service { id: 17664e32-68d9-4b36-8d33-e7dfbc57f33e }, name: Name("nexus-17664e32-68d9-4b36-8d33-e7dfbc57f33e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15972024-08-03T04:37:45.286ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15982024-08-03T04:37:45.286ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15992024-08-03T04:37:45.286ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16002024-08-03T04:37:45.286ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
16012024-08-03T04:37:45.286ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16022024-08-03T04:37:45.286ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16032024-08-03T04:37:45.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49579 req_id = ccff525f-641b-4fc9-9e6a-317318f746f5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16042024-08-03T04:37:45.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48021
16052024-08-03T04:37:45.341ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3295b879-d7a7-43b9-974f-693c44ae1caf, kind: Service { id: 97ec20c6-2686-4dd7-b53b-c077ae6d0eb8 }, name: Name("external-dns-97ec20c6-2686-4dd7-b53b-c077ae6d0eb8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 33])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40700bba-c501-4ab6-824f-e22cd70b9e0b, kind: Service { id: 3ae46f76-c564-4aa0-92cc-6b2618c98bfb }, name: Name("external-dns-3ae46f76-c564-4aa0-92cc-6b2618c98bfb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0955e115-6d30-4f1c-ac2d-483a53fbde57, kind: Service { id: adde72dd-c12b-4912-bc90-d32e0e191860 }, name: Name("nexus-adde72dd-c12b-4912-bc90-d32e0e191860"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bca5b15-b5be-4740-b204-2cf8307b0f09, kind: Service { id: 224a7dd7-29d8-4168-b114-549087c4dbdd }, name: Name("nexus-224a7dd7-29d8-4168-b114-549087c4dbdd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd08eb98-9af5-4618-9458-5a9592c90353, kind: Service { id: 17664e32-68d9-4b36-8d33-e7dfbc57f33e }, name: Name("nexus-17664e32-68d9-4b36-8d33-e7dfbc57f33e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16062024-08-03T04:37:45.341ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16072024-08-03T04:37:45.341ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16082024-08-03T04:37:45.341ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16092024-08-03T04:37:45.341ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
16102024-08-03T04:37:45.341ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16112024-08-03T04:37:45.341ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16122024-08-03T04:37:45.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48021 req_id = 85cce88b-1908-42db-994d-21e0efd75a22 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16132024-08-03T04:37:50.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35127
16142024-08-03T04:37:50.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35127 req_id = e49cace8-f7ac-49d8-bb0f-8450d8dd2c82 response_code = 200 uri = /vpc-routes
16152024-08-03T04:37:50.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35127 req_id = 5795753d-9db9-4f7d-8ad4-e40f9cec70e7 response_code = 204 uri = /vpc-routes
16162024-08-03T04:37:54.655ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41242
16172024-08-03T04:37:54.655ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 602 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41242 req_id = 3571aa04-c7f5-4013-b4c5-36b43e87a8e1 response_code = 200 uri = /baseboard
16182024-08-03T04:38:07.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42209
16192024-08-03T04:38:07.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42209 req_id = 5de057f1-a531-4a2d-a0d5-d5b2e0b8bfb3 response_code = 200 uri = /vpc-routes
16202024-08-03T04:38:07.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42209 req_id = 030a5be2-92d5-44a5-8d1f-d3f23e1914d7 response_code = 204 uri = /vpc-routes
16212024-08-03T04:38:07.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46671
16222024-08-03T04:38:07.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 632 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46671 req_id = 6186db68-1d96-4ed1-ba5a-78298d4e8a76 response_code = 200 uri = /v2p
16232024-08-03T04:38:08.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54688
16242024-08-03T04:38:08.045ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
16252024-08-03T04:38:08.115ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
16262024-08-03T04:38:08.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 102779 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54688 req_id = e3be1936-ae67-49dd-8ab7-ebab6866728b response_code = 204 uri = /switch-ports
16272024-08-03T04:38:08.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 3681 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54688 req_id = 96b6e945-ac26-4f3a-84cc-e18f3b7572b0 response_code = 200 uri = /network-bootstore-config
16282024-08-03T04:38:08.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61342
16292024-08-03T04:38:08.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 646 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61342 req_id = 32b4a37c-71a6-44f7-8f02-6dcdda29ea5c response_code = 200 uri = /vpc-routes
16302024-08-03T04:38:08.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61342 req_id = a7386c0d-8643-4e71-8e11-614f57f3eed0 response_code = 204 uri = /vpc-routes
16312024-08-03T04:38:08.183ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
16322024-08-03T04:38:08.183ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16332024-08-03T04:38:08.184ZINFOSledAgent (bootstore): Writing ledger to /pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16342024-08-03T04:38:08.185ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
16352024-08-03T04:38:08.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 3819 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54688 req_id = 05de10b0-a996-439d-a342-236a6b8f4f41 response_code = 204 uri = /network-bootstore-config
16362024-08-03T04:38:08.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36228
16372024-08-03T04:38:08.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36228 req_id = d1bc156c-728c-455b-9261-5c2f1e4d5280 response_code = 200 uri = /v2p
16382024-08-03T04:38:08.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52118
16392024-08-03T04:38:08.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52118 req_id = 9e7827be-4fce-494d-adf6-a8dc30b9e60d response_code = 200 uri = /v2p
16402024-08-03T04:38:08.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52701
16412024-08-03T04:38:08.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52701 req_id = e8da2ebe-62c6-433d-ab46-06fd170bfcfb response_code = 200 uri = /vpc-routes
16422024-08-03T04:38:08.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 697 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52701 req_id = 54efd3b4-0241-49af-8044-78c71a2d1d45 response_code = 204 uri = /vpc-routes
16432024-08-03T04:38:08.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36520
16442024-08-03T04:38:08.603ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
16452024-08-03T04:38:08.631ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
16462024-08-03T04:38:08.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 52366 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36520 req_id = 4aeaf15a-2545-40ec-89ca-03ba9e0a8fad response_code = 204 uri = /switch-ports
16472024-08-03T04:38:08.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36520 req_id = 3847aea3-8046-4671-bf82-cca90dff7bff response_code = 200 uri = /network-bootstore-config
16482024-08-03T04:38:08.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59450
16492024-08-03T04:38:08.712ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
16502024-08-03T04:38:08.737ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
16512024-08-03T04:38:08.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 50767 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59450 req_id = e74b91ff-5aa9-4c7b-8d12-c5f6aa376a94 response_code = 204 uri = /switch-ports
16522024-08-03T04:38:08.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 665 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59450 req_id = 06db21e7-4ecc-4f86-a8a5-94a7e45f4652 response_code = 200 uri = /network-bootstore-config
16532024-08-03T04:38:12.512ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 676 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = 39f07849-bccc-4a8f-80f0-1fa398ddb176 response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
16542024-08-03T04:38:24.690ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34855
16552024-08-03T04:38:24.691ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34855 req_id = bf43620e-070a-4a47-9c73-2d65bf07f475 response_code = 200 uri = /baseboard
16562024-08-03T04:38:37.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42598
16572024-08-03T04:38:37.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42598 req_id = e83344b4-29da-44cf-b5ab-8091233cb118 response_code = 200 uri = /vpc-routes
16582024-08-03T04:38:37.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 679 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42598 req_id = e24d824c-622b-49a0-b4a2-46ef610daeb1 response_code = 204 uri = /vpc-routes
16592024-08-03T04:38:37.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57588
16602024-08-03T04:38:37.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57588 req_id = 3b390206-6848-4d61-b089-23c28ed0a1f9 response_code = 200 uri = /v2p
16612024-08-03T04:38:37.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32941
16622024-08-03T04:38:37.772ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
16632024-08-03T04:38:37.796ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
16642024-08-03T04:38:37.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 47659 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32941 req_id = bb311b44-8f62-4bc7-a2a6-3176d1feeec0 response_code = 204 uri = /switch-ports
16652024-08-03T04:38:37.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32941 req_id = 88621b12-1406-4c22-9fc0-e15abdb69516 response_code = 200 uri = /network-bootstore-config
16662024-08-03T04:38:38.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51573
16672024-08-03T04:38:38.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51573 req_id = b37cc849-f2f7-4c34-96eb-0e879801bb24 response_code = 200 uri = /v2p
16682024-08-03T04:38:38.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39806
16692024-08-03T04:38:38.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39806 req_id = c7dbbd64-59e6-4b27-b4cc-8bca154f4336 response_code = 200 uri = /vpc-routes
16702024-08-03T04:38:38.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39806 req_id = 84a3ff2f-33bb-451f-9a25-c8830d059088 response_code = 204 uri = /vpc-routes
16712024-08-03T04:38:38.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65226
16722024-08-03T04:38:38.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65226 req_id = aa5287e3-c4ff-463c-89b1-bc917c40d45b response_code = 200 uri = /vpc-routes
16732024-08-03T04:38:38.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65226 req_id = c6a6f2df-e4be-4201-a84f-d79431ae8e09 response_code = 204 uri = /vpc-routes
16742024-08-03T04:38:38.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41267
16752024-08-03T04:38:38.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 759 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41267 req_id = 50d9ef14-185e-4f7a-9a69-e48f99221428 response_code = 200 uri = /v2p
16762024-08-03T04:38:38.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39981
16772024-08-03T04:38:38.283ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
16782024-08-03T04:38:38.310ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
16792024-08-03T04:38:38.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 49342 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39981 req_id = d1327940-fe64-496e-914a-294c1818963c response_code = 204 uri = /switch-ports
16802024-08-03T04:38:38.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 672 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39981 req_id = ca8a8460-896e-4912-97f4-c276501676e2 response_code = 200 uri = /network-bootstore-config
16812024-08-03T04:38:38.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56222
16822024-08-03T04:38:38.412ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
16832024-08-03T04:38:38.436ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
16842024-08-03T04:38:38.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 46738 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56222 req_id = f04b5611-20f8-416f-8ec0-4cfc3f9eebd5 response_code = 204 uri = /switch-ports
16852024-08-03T04:38:38.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56222 req_id = b784cdbb-0976-4672-b9e9-1b284296ce49 response_code = 200 uri = /network-bootstore-config
16862024-08-03T04:38:42.515ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1963 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = 734ef68a-52d2-42ae-8b64-be15459b9b3a response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
16872024-08-03T04:38:54.723ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65134
16882024-08-03T04:38:54.723ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 700 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65134 req_id = 0fa569f0-7cc2-4fef-91f0-b2957888dcee response_code = 200 uri = /baseboard
16892024-08-03T04:39:07.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53473
16902024-08-03T04:39:07.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53473 req_id = af848a51-fd24-4769-b99e-ad72a1e0fa9a response_code = 200 uri = /v2p
16912024-08-03T04:39:07.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46611
16922024-08-03T04:39:07.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46611 req_id = ec7ee61d-da1e-4fa9-881a-652aaad7c88f response_code = 200 uri = /vpc-routes
16932024-08-03T04:39:07.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46611 req_id = e039592a-15cd-413a-a0e3-bccdbca16dcb response_code = 204 uri = /vpc-routes
16942024-08-03T04:39:08.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55575
16952024-08-03T04:39:08.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55575 req_id = 11120790-7aa5-4040-9acf-a8cd5efa5c43 response_code = 200 uri = /vpc-routes
16962024-08-03T04:39:08.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40122
16972024-08-03T04:39:08.100ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
16982024-08-03T04:39:08.127ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
16992024-08-03T04:39:08.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 51864 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40122 req_id = e4b4e807-9724-454a-a740-33c7c4be711e response_code = 204 uri = /switch-ports
17002024-08-03T04:39:08.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44424
17012024-08-03T04:39:08.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44424 req_id = 687c440b-c627-4f76-a3be-dc0999715e70 response_code = 200 uri = /v2p
17022024-08-03T04:39:08.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55575 req_id = 51985a5f-7dbb-40c9-bd19-4837c9d79dbf response_code = 204 uri = /vpc-routes
17032024-08-03T04:39:08.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40122 req_id = b12e0033-f773-4ecc-a8bc-bdcece3b07f1 response_code = 200 uri = /network-bootstore-config
17042024-08-03T04:39:08.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52156
17052024-08-03T04:39:08.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52156 req_id = 1e0e5a73-2678-4f36-a8a4-bb3e72a81c98 response_code = 200 uri = /v2p
17062024-08-03T04:39:08.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62905
17072024-08-03T04:39:08.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 832 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62905 req_id = be9e55be-c6aa-4bbe-b0a3-471cc601910f response_code = 200 uri = /vpc-routes
17082024-08-03T04:39:08.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62905 req_id = b0eebf8e-da06-4ceb-820b-6d6c8febcdc3 response_code = 204 uri = /vpc-routes
17092024-08-03T04:39:08.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34928
17102024-08-03T04:39:08.509ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
17112024-08-03T04:39:08.533ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
17122024-08-03T04:39:08.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 46306 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34928 req_id = 3af206dd-c7a2-4a46-8bac-63b9cdb23025 response_code = 204 uri = /switch-ports
17132024-08-03T04:39:08.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 893 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34928 req_id = c97c8ba6-f066-4d49-bd35-4233e437c8ba response_code = 200 uri = /network-bootstore-config
17142024-08-03T04:39:08.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45181
17152024-08-03T04:39:08.652ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
17162024-08-03T04:39:08.679ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
17172024-08-03T04:39:08.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 51029 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45181 req_id = fbfffed3-20ed-447a-afed-65e5d67c67d7 response_code = 204 uri = /switch-ports
17182024-08-03T04:39:08.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45181 req_id = 7e388b53-5697-405d-b518-0a20bb7134c5 response_code = 200 uri = /network-bootstore-config
17192024-08-03T04:39:12.513ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1145 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = 2358cfc1-977b-4cc2-9084-adaba9707248 response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
17202024-08-03T04:39:24.755ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57178
17212024-08-03T04:39:24.756ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 687 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57178 req_id = 2d41cca1-4984-4105-ac47-cd10a6a3c7e6 response_code = 200 uri = /baseboard
17222024-08-03T04:39:37.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33502
17232024-08-03T04:39:37.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33502 req_id = abab74af-760f-4759-b4e8-12b7559eb7f1 response_code = 200 uri = /vpc-routes
17242024-08-03T04:39:37.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 776 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33502 req_id = 741c483b-b3af-4ffd-a741-fd742b8d6176 response_code = 204 uri = /vpc-routes
17252024-08-03T04:39:37.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35391
17262024-08-03T04:39:37.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35391 req_id = 5df06400-887d-45ef-b18b-bed4b34a7067 response_code = 200 uri = /v2p
17272024-08-03T04:39:37.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44866
17282024-08-03T04:39:37.841ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
17292024-08-03T04:39:37.866ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
17302024-08-03T04:39:37.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 47478 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44866 req_id = 32a847fd-a1fb-450a-952a-d7d195132532 response_code = 204 uri = /switch-ports
17312024-08-03T04:39:37.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44866 req_id = 6827d409-9df3-4599-9900-18c9d412d30c response_code = 200 uri = /network-bootstore-config
17322024-08-03T04:39:38.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46281
17332024-08-03T04:39:38.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46281 req_id = 5ec5bd50-3966-451d-8b6d-7b86663544cc response_code = 200 uri = /v2p
17342024-08-03T04:39:38.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50194
17352024-08-03T04:39:38.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50194 req_id = a5b8ddcf-f457-480d-8714-117f5601e66c response_code = 200 uri = /vpc-routes
17362024-08-03T04:39:38.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50194 req_id = 4bd88ef4-a143-422f-a68c-733626b28c3f response_code = 204 uri = /vpc-routes
17372024-08-03T04:39:38.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42020
17382024-08-03T04:39:38.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42020 req_id = 54b49a10-36b4-455b-96f7-38f7b134a6e6 response_code = 200 uri = /v2p
17392024-08-03T04:39:38.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45328
17402024-08-03T04:39:38.273ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
17412024-08-03T04:39:38.298ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
17422024-08-03T04:39:38.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 48772 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45328 req_id = e2e5025e-c121-482f-b232-9c48115fd814 response_code = 204 uri = /switch-ports
17432024-08-03T04:39:38.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53389
17442024-08-03T04:39:38.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53389 req_id = 91a02334-4d63-4256-8a72-3b2b784d76db response_code = 200 uri = /vpc-routes
17452024-08-03T04:39:38.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 694 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45328 req_id = 5a47a147-3388-4417-80fa-f7f45725a475 response_code = 200 uri = /network-bootstore-config
17462024-08-03T04:39:38.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53389 req_id = b1b455f1-5e4a-49ad-8649-299789c1a882 response_code = 204 uri = /vpc-routes
17472024-08-03T04:39:38.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42922
17482024-08-03T04:39:38.404ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
17492024-08-03T04:39:38.428ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
17502024-08-03T04:39:38.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 48256 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42922 req_id = aa0aab1e-d9bd-48c9-96cb-a4557bd25c49 response_code = 204 uri = /switch-ports
17512024-08-03T04:39:38.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42922 req_id = d0f87590-9652-4e61-b9c3-c8ce0e6eae5f response_code = 200 uri = /network-bootstore-config
17522024-08-03T04:39:42.526ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 387 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = dbc8a472-6a0e-4d87-9edd-cac2739f5100 response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
17532024-08-03T04:39:54.788ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45763
17542024-08-03T04:39:54.788ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45763 req_id = 5b71309e-d676-4f97-96bd-2aef44d96499 response_code = 200 uri = /baseboard
17552024-08-03T04:40:07.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49795
17562024-08-03T04:40:07.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49795 req_id = d28dea13-7e59-4de2-a8a3-3321c057f6e1 response_code = 200 uri = /v2p
17572024-08-03T04:40:07.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43678
17582024-08-03T04:40:07.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43678 req_id = a63b9586-9a84-4f90-8250-359bc547b53f response_code = 200 uri = /vpc-routes
17592024-08-03T04:40:07.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43678 req_id = 99abf5ff-42d8-4a11-974e-28db7edf69aa response_code = 204 uri = /vpc-routes
17602024-08-03T04:40:08.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36419
17612024-08-03T04:40:08.068ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
17622024-08-03T04:40:08.100ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
17632024-08-03T04:40:08.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 57924 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36419 req_id = 7bbe5bc3-9103-4e9c-9d9e-b72b689f4ad8 response_code = 204 uri = /switch-ports
17642024-08-03T04:40:08.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36419 req_id = 225000c2-2183-4b72-82c1-f45a999ad9bd response_code = 200 uri = /network-bootstore-config
17652024-08-03T04:40:08.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33377
17662024-08-03T04:40:08.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33377 req_id = 0fa71f6e-8746-41df-b74c-990cfd431811 response_code = 200 uri = /vpc-routes
17672024-08-03T04:40:08.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33377 req_id = 792a1e6c-1ef6-42b2-9f21-12c5d8df5394 response_code = 204 uri = /vpc-routes
17682024-08-03T04:40:08.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33970
17692024-08-03T04:40:08.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33970 req_id = 53ff53f8-171f-49fd-996b-7da51f22bb3c response_code = 200 uri = /v2p
17702024-08-03T04:40:08.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50516
17712024-08-03T04:40:08.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50516 req_id = 7af03fe3-258a-4590-a740-9a560a374d59 response_code = 200 uri = /vpc-routes
17722024-08-03T04:40:08.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50516 req_id = 575cb39b-e9ad-4b59-b21b-11da699d8e3e response_code = 204 uri = /vpc-routes
17732024-08-03T04:40:08.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56386
17742024-08-03T04:40:08.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56386 req_id = 24d7e6d3-a63f-461c-800f-45588b9ff7d4 response_code = 200 uri = /v2p
17752024-08-03T04:40:08.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34343
17762024-08-03T04:40:08.464ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
17772024-08-03T04:40:08.490ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
17782024-08-03T04:40:08.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 48075 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34343 req_id = 0242df6b-fa73-4e32-a772-a5aaaf334584 response_code = 204 uri = /switch-ports
17792024-08-03T04:40:08.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 885 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34343 req_id = aa624049-a742-4602-a9d9-1161cfb0b60f response_code = 200 uri = /network-bootstore-config
17802024-08-03T04:40:08.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37728
17812024-08-03T04:40:08.633ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
17822024-08-03T04:40:08.658ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
17832024-08-03T04:40:08.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 48608 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37728 req_id = e236a0d1-c089-4942-8e49-559b8cd03bae response_code = 204 uri = /switch-ports
17842024-08-03T04:40:08.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37728 req_id = 22bea210-a32c-4880-a2f5-a3ddfdf75d6f response_code = 200 uri = /network-bootstore-config
17852024-08-03T04:40:10.398ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
17862024-08-03T04:40:12.596ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 612 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = 966ebab3-8acb-49ec-a333-d8a3d54b5943 response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
17872024-08-03T04:40:24.821ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58794
17882024-08-03T04:40:24.821ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58794 req_id = 099128b7-81dc-44b3-a9f2-d998fb9f9f7b response_code = 200 uri = /baseboard
17892024-08-03T04:40:37.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55572
17902024-08-03T04:40:37.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55572 req_id = b325d9be-676e-4049-904d-d7aa669a7eb5 response_code = 200 uri = /v2p
17912024-08-03T04:40:37.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61782
17922024-08-03T04:40:37.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61782 req_id = 484fe10c-9727-491f-a2fd-f8b20230dc35 response_code = 200 uri = /vpc-routes
17932024-08-03T04:40:37.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61782 req_id = 8a415f2e-98e3-4cc6-acdc-ea2d929f700b response_code = 204 uri = /vpc-routes
17942024-08-03T04:40:37.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43195
17952024-08-03T04:40:37.908ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
17962024-08-03T04:40:37.939ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
17972024-08-03T04:40:37.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 63774 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43195 req_id = cc2a3bb7-2633-4869-935f-62731c9c174b response_code = 204 uri = /switch-ports
17982024-08-03T04:40:37.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43195 req_id = c07c6db1-e0ce-4d92-a484-f33d77f84b4b response_code = 200 uri = /network-bootstore-config
17992024-08-03T04:40:38.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32994
18002024-08-03T04:40:38.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32994 req_id = 27d689bc-6d51-415f-9739-3f002cd5e2c2 response_code = 200 uri = /v2p
18012024-08-03T04:40:38.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37899
18022024-08-03T04:40:38.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37899 req_id = 4894bab5-dc08-4308-b515-e6bfdeef4652 response_code = 200 uri = /vpc-routes
18032024-08-03T04:40:38.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37899 req_id = ad08761a-4177-461e-a676-f0c983f07899 response_code = 204 uri = /vpc-routes
18042024-08-03T04:40:38.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49082
18052024-08-03T04:40:38.268ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
18062024-08-03T04:40:38.301ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
18072024-08-03T04:40:38.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 64540 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49082 req_id = 09ee080d-b48f-49a6-b6dc-347170830995 response_code = 204 uri = /switch-ports
18082024-08-03T04:40:38.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37913
18092024-08-03T04:40:38.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49082 req_id = 41115dd7-ee80-42af-b64d-f26880d92ee5 response_code = 200 uri = /network-bootstore-config
18102024-08-03T04:40:38.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52741
18112024-08-03T04:40:38.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37913 req_id = d4e15178-8e85-4e1c-9b6f-05c107d880d5 response_code = 200 uri = /vpc-routes
18122024-08-03T04:40:38.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1037 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52741 req_id = 86974b17-25f3-4490-b04e-8aceea16b046 response_code = 200 uri = /v2p
18132024-08-03T04:40:38.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37913 req_id = 4c316b3f-4ef4-46b4-98ea-32abdcd1c3b9 response_code = 204 uri = /vpc-routes
18142024-08-03T04:40:38.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38219
18152024-08-03T04:40:38.450ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
18162024-08-03T04:40:38.485ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
18172024-08-03T04:40:38.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 66919 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38219 req_id = 08e70a3e-f86c-491f-8bab-ae4c5e274294 response_code = 204 uri = /switch-ports
18182024-08-03T04:40:38.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38219 req_id = ec4525d8-1580-48c4-ac6b-ca0e5e1325b7 response_code = 200 uri = /network-bootstore-config
18192024-08-03T04:40:42.597ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 703 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = 7a5df928-3e62-4387-984d-8594e7455957 response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
18202024-08-03T04:40:54.855ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37030
18212024-08-03T04:40:54.855ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37030 req_id = c5cc079a-0ab0-445a-aae8-7a24b37d36b2 response_code = 200 uri = /baseboard
18222024-08-03T04:41:07.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36003
18232024-08-03T04:41:07.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36003 req_id = 90a3eb3d-a7b4-442f-b722-3422a157ba33 response_code = 200 uri = /vpc-routes
18242024-08-03T04:41:07.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36003 req_id = e4d86fa3-2d10-4abc-904e-9b044ccfb770 response_code = 204 uri = /vpc-routes
18252024-08-03T04:41:07.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51381
18262024-08-03T04:41:07.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51381 req_id = ac679081-5fe7-48e9-9950-9583de72765a response_code = 200 uri = /v2p
18272024-08-03T04:41:08.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54038
18282024-08-03T04:41:08.043ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
18292024-08-03T04:41:08.074ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
18302024-08-03T04:41:08.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 57135 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54038 req_id = 84683fc9-d8dc-4fbe-bd88-07bd33660441 response_code = 204 uri = /switch-ports
18312024-08-03T04:41:08.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54038 req_id = 7ecd4b04-7846-46bf-8cca-c0c25db04315 response_code = 200 uri = /network-bootstore-config
18322024-08-03T04:41:08.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65408
18332024-08-03T04:41:08.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65408 req_id = 7d9f02d1-7ba9-408e-89ea-c6be18f82812 response_code = 200 uri = /v2p
18342024-08-03T04:41:08.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45100
18352024-08-03T04:41:08.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45100 req_id = 9c745a9f-d836-4071-a54b-25c113b02665 response_code = 200 uri = /vpc-routes
18362024-08-03T04:41:08.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 858 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45100 req_id = 4f41fb2a-1b34-49f8-9645-96b49a53fd7f response_code = 204 uri = /vpc-routes
18372024-08-03T04:41:08.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39710
18382024-08-03T04:41:08.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39710 req_id = c9437269-bd11-442e-a0a8-38c3e6cb9195 response_code = 200 uri = /v2p
18392024-08-03T04:41:08.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64880
18402024-08-03T04:41:08.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64880 req_id = b340305a-4bd4-4bd8-81cb-7304acfe84a6 response_code = 200 uri = /vpc-routes
18412024-08-03T04:41:08.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64880 req_id = 4cd8a54c-3369-429b-be57-fc41094a8544 response_code = 204 uri = /vpc-routes
18422024-08-03T04:41:08.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40258
18432024-08-03T04:41:08.450ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
18442024-08-03T04:41:08.476ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
18452024-08-03T04:41:08.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 50464 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40258 req_id = 8484c4b6-50cb-4e0f-a07c-c94e5615d946 response_code = 204 uri = /switch-ports
18462024-08-03T04:41:08.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40258 req_id = d1c61370-7101-4f19-988b-ba5893139453 response_code = 200 uri = /network-bootstore-config
18472024-08-03T04:41:08.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45405
18482024-08-03T04:41:08.778ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
18492024-08-03T04:41:08.805ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
18502024-08-03T04:41:08.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 50803 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45405 req_id = 528e3106-056b-4e01-8687-aac5e646f6ca response_code = 204 uri = /switch-ports
18512024-08-03T04:41:08.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45405 req_id = 55e37a47-5c6c-4ee7-a5c3-7fec2707473b response_code = 200 uri = /network-bootstore-config
18522024-08-03T04:41:12.597ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 553 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = 5ac48869-9934-4431-bfa0-f17696a4431c response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
18532024-08-03T04:41:24.887ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46278
18542024-08-03T04:41:24.888ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 94 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46278 req_id = e6cfbe0e-63f8-4991-9047-b458f6f7cef2 response_code = 200 uri = /baseboard
18552024-08-03T04:41:37.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61726
18562024-08-03T04:41:37.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61726 req_id = 21286314-f309-43db-a323-177846d0af0e response_code = 200 uri = /vpc-routes
18572024-08-03T04:41:37.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 873 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61726 req_id = 47329aae-ec85-4447-820c-23eb9adb2d52 response_code = 204 uri = /vpc-routes
18582024-08-03T04:41:37.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39747
18592024-08-03T04:41:37.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39747 req_id = 89a3b3ee-2d70-45b2-be23-fd2b7a9b1250 response_code = 200 uri = /v2p
18602024-08-03T04:41:37.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39818
18612024-08-03T04:41:37.831ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
18622024-08-03T04:41:37.856ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
18632024-08-03T04:41:37.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 48570 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39818 req_id = dac1689d-b3d1-4e20-92e0-e5a77fc4ed03 response_code = 204 uri = /switch-ports
18642024-08-03T04:41:37.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39818 req_id = 6c276203-d545-4f4e-8d00-5aba483e9dca response_code = 200 uri = /network-bootstore-config
18652024-08-03T04:41:38.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51222
18662024-08-03T04:41:38.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51222 req_id = a05d54d2-be97-4cba-8ac7-50097d4f9450 response_code = 200 uri = /vpc-routes
18672024-08-03T04:41:38.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51222 req_id = 98316b17-1f3d-4012-9f16-070a882a91f7 response_code = 204 uri = /vpc-routes
18682024-08-03T04:41:38.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36154
18692024-08-03T04:41:38.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36154 req_id = 206bd71f-99b3-445c-a338-ff867739bd48 response_code = 200 uri = /v2p
18702024-08-03T04:41:38.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38102
18712024-08-03T04:41:38.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38102 req_id = f1286526-dcff-46f5-ae0e-658f8d52f432 response_code = 200 uri = /vpc-routes
18722024-08-03T04:41:38.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38810
18732024-08-03T04:41:38.207ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
18742024-08-03T04:41:38.233ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
18752024-08-03T04:41:38.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 50502 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38810 req_id = 8bdf95d7-7e0d-4f0e-bfee-48fad1d8c236 response_code = 204 uri = /switch-ports
18762024-08-03T04:41:38.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64404
18772024-08-03T04:41:38.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64404 req_id = 46bd8b15-bfa1-4481-9cc9-f8fcaa43d686 response_code = 200 uri = /v2p
18782024-08-03T04:41:38.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38810 req_id = f0a48e02-b0eb-41c6-ba2b-d4fc5abf5250 response_code = 200 uri = /network-bootstore-config
18792024-08-03T04:41:38.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38102 req_id = ad0b2a11-3af1-4a31-a102-2ba4d348973f response_code = 204 uri = /vpc-routes
18802024-08-03T04:41:38.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50253
18812024-08-03T04:41:38.421ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
18822024-08-03T04:41:38.444ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
18832024-08-03T04:41:38.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 44643 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50253 req_id = 6d3e027d-ba0f-40e6-ad8c-8b4fdfb35ba5 response_code = 204 uri = /switch-ports
18842024-08-03T04:41:38.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50253 req_id = 6d60224a-4721-4467-86c3-88105db72b73 response_code = 200 uri = /network-bootstore-config
18852024-08-03T04:41:42.597ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 616 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = 427cb297-ad04-4448-849c-4af2cb5357cb response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
18862024-08-03T04:41:54.920ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54592
18872024-08-03T04:41:54.920ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54592 req_id = 30b64faf-c28d-47b1-aadf-13fdecdbd8af response_code = 200 uri = /baseboard
18882024-08-03T04:42:07.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64775
18892024-08-03T04:42:07.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64775 req_id = 015df115-40d0-47a5-b80b-9e549fdd2593 response_code = 200 uri = /v2p
18902024-08-03T04:42:07.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59880
18912024-08-03T04:42:07.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59880 req_id = 3b1bc614-fc75-4b02-b772-20f069313ff3 response_code = 200 uri = /vpc-routes
18922024-08-03T04:42:07.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59880 req_id = 5b1fe33c-e9af-4914-999c-13bb326b3e18 response_code = 204 uri = /vpc-routes
18932024-08-03T04:42:07.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33055
18942024-08-03T04:42:07.878ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3295b879-d7a7-43b9-974f-693c44ae1caf, kind: Service { id: 97ec20c6-2686-4dd7-b53b-c077ae6d0eb8 }, name: Name("external-dns-97ec20c6-2686-4dd7-b53b-c077ae6d0eb8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 33])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40700bba-c501-4ab6-824f-e22cd70b9e0b, kind: Service { id: 3ae46f76-c564-4aa0-92cc-6b2618c98bfb }, name: Name("external-dns-3ae46f76-c564-4aa0-92cc-6b2618c98bfb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0955e115-6d30-4f1c-ac2d-483a53fbde57, kind: Service { id: adde72dd-c12b-4912-bc90-d32e0e191860 }, name: Name("nexus-adde72dd-c12b-4912-bc90-d32e0e191860"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bca5b15-b5be-4740-b204-2cf8307b0f09, kind: Service { id: 224a7dd7-29d8-4168-b114-549087c4dbdd }, name: Name("nexus-224a7dd7-29d8-4168-b114-549087c4dbdd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd08eb98-9af5-4618-9458-5a9592c90353, kind: Service { id: 17664e32-68d9-4b36-8d33-e7dfbc57f33e }, name: Name("nexus-17664e32-68d9-4b36-8d33-e7dfbc57f33e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18952024-08-03T04:42:07.878ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18962024-08-03T04:42:07.878ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18972024-08-03T04:42:07.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18982024-08-03T04:42:07.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
18992024-08-03T04:42:07.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19002024-08-03T04:42:07.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19012024-08-03T04:42:07.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 939 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33055 req_id = 7ac0aa4f-8541-4488-8d82-c9278aa2c1c1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19022024-08-03T04:42:08.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64831
19032024-08-03T04:42:08.219ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
19042024-08-03T04:42:08.250ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
19052024-08-03T04:42:08.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 56665 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64831 req_id = bba36819-a1c7-4541-ac9c-bdd3a7814c29 response_code = 204 uri = /switch-ports
19062024-08-03T04:42:08.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64831 req_id = 4bebcc2f-0ae1-4c64-b384-294d77d47560 response_code = 200 uri = /network-bootstore-config
19072024-08-03T04:42:08.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43497
19082024-08-03T04:42:08.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1002 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43497 req_id = faf8a9af-55a7-4c07-8981-e6ba62a0ea68 response_code = 200 uri = /v2p
19092024-08-03T04:42:08.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38995
19102024-08-03T04:42:08.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38995 req_id = 4a33dcb8-4b6d-48ca-82a7-70b3fae3acb7 response_code = 200 uri = /v2p
19112024-08-03T04:42:08.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55212
19122024-08-03T04:42:08.339ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3295b879-d7a7-43b9-974f-693c44ae1caf, kind: Service { id: 97ec20c6-2686-4dd7-b53b-c077ae6d0eb8 }, name: Name("external-dns-97ec20c6-2686-4dd7-b53b-c077ae6d0eb8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 33])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40700bba-c501-4ab6-824f-e22cd70b9e0b, kind: Service { id: 3ae46f76-c564-4aa0-92cc-6b2618c98bfb }, name: Name("external-dns-3ae46f76-c564-4aa0-92cc-6b2618c98bfb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0955e115-6d30-4f1c-ac2d-483a53fbde57, kind: Service { id: adde72dd-c12b-4912-bc90-d32e0e191860 }, name: Name("nexus-adde72dd-c12b-4912-bc90-d32e0e191860"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bca5b15-b5be-4740-b204-2cf8307b0f09, kind: Service { id: 224a7dd7-29d8-4168-b114-549087c4dbdd }, name: Name("nexus-224a7dd7-29d8-4168-b114-549087c4dbdd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd08eb98-9af5-4618-9458-5a9592c90353, kind: Service { id: 17664e32-68d9-4b36-8d33-e7dfbc57f33e }, name: Name("nexus-17664e32-68d9-4b36-8d33-e7dfbc57f33e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19132024-08-03T04:42:08.339ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19142024-08-03T04:42:08.339ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19152024-08-03T04:42:08.339ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19162024-08-03T04:42:08.339ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
19172024-08-03T04:42:08.339ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19182024-08-03T04:42:08.339ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19192024-08-03T04:42:08.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55212 req_id = 84eb13cb-f225-43dc-b09a-be42758dfec3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19202024-08-03T04:42:08.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35112
19212024-08-03T04:42:08.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35112 req_id = 2c156e1b-3a68-4799-8df8-147eb2f12570 response_code = 200 uri = /vpc-routes
19222024-08-03T04:42:08.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35112 req_id = 4aec2888-fa29-4173-b4f3-8dde01e31c3f response_code = 204 uri = /vpc-routes
19232024-08-03T04:42:08.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40913
19242024-08-03T04:42:08.497ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
19252024-08-03T04:42:08.523ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
19262024-08-03T04:42:08.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 50259 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40913 req_id = 6faf6c52-ae7f-40a7-9902-a2b8f9a7f8f4 response_code = 204 uri = /switch-ports
19272024-08-03T04:42:08.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45723
19282024-08-03T04:42:08.548ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3295b879-d7a7-43b9-974f-693c44ae1caf, kind: Service { id: 97ec20c6-2686-4dd7-b53b-c077ae6d0eb8 }, name: Name("external-dns-97ec20c6-2686-4dd7-b53b-c077ae6d0eb8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 33])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40700bba-c501-4ab6-824f-e22cd70b9e0b, kind: Service { id: 3ae46f76-c564-4aa0-92cc-6b2618c98bfb }, name: Name("external-dns-3ae46f76-c564-4aa0-92cc-6b2618c98bfb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0955e115-6d30-4f1c-ac2d-483a53fbde57, kind: Service { id: adde72dd-c12b-4912-bc90-d32e0e191860 }, name: Name("nexus-adde72dd-c12b-4912-bc90-d32e0e191860"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bca5b15-b5be-4740-b204-2cf8307b0f09, kind: Service { id: 224a7dd7-29d8-4168-b114-549087c4dbdd }, name: Name("nexus-224a7dd7-29d8-4168-b114-549087c4dbdd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd08eb98-9af5-4618-9458-5a9592c90353, kind: Service { id: 17664e32-68d9-4b36-8d33-e7dfbc57f33e }, name: Name("nexus-17664e32-68d9-4b36-8d33-e7dfbc57f33e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19292024-08-03T04:42:08.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19302024-08-03T04:42:08.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40913 req_id = 7b52df13-21a3-46eb-abae-5a15d15fc216 response_code = 200 uri = /network-bootstore-config
19312024-08-03T04:42:08.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19322024-08-03T04:42:08.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19332024-08-03T04:42:08.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
19342024-08-03T04:42:08.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19352024-08-03T04:42:08.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19362024-08-03T04:42:08.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 473 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45723 req_id = 5ebdcf38-c98f-40d7-a402-5b86be89db84 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19372024-08-03T04:42:08.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63557
19382024-08-03T04:42:08.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63557 req_id = 2ea5ad2a-5e66-48a0-8fe2-8ee6ca06f3d6 response_code = 200 uri = /vpc-routes
19392024-08-03T04:42:08.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63557 req_id = 33e7ac67-68c1-4f6c-8d5b-f42ed93b72ca response_code = 204 uri = /vpc-routes
19402024-08-03T04:42:08.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60989
19412024-08-03T04:42:08.710ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
19422024-08-03T04:42:08.734ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
19432024-08-03T04:42:08.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 49159 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60989 req_id = 92d64899-23a0-4420-927d-a8a67bfb778c response_code = 204 uri = /switch-ports
19442024-08-03T04:42:08.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60989 req_id = cb20bc0a-0f1f-480b-b34f-0b26fc5fffdb response_code = 200 uri = /network-bootstore-config
19452024-08-03T04:42:12.599ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1938 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = 5e74b07e-e6ad-44d9-8811-e91f741ea6e8 response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
19462024-08-03T04:42:24.952ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55760
19472024-08-03T04:42:24.953ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 425 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55760 req_id = 09d12cf6-f0eb-446b-90d3-24f407aee3dd response_code = 200 uri = /baseboard
19482024-08-03T04:42:37.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63341
19492024-08-03T04:42:37.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 729 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63341 req_id = 3c5228ec-b55b-4264-aef9-64c85a585247 response_code = 200 uri = /vpc-routes
19502024-08-03T04:42:37.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63341 req_id = 8655d709-f47e-4e5b-9396-f7ec94fc80bb response_code = 204 uri = /vpc-routes
19512024-08-03T04:42:37.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37026
19522024-08-03T04:42:37.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37026 req_id = 1c97f687-66df-4d98-a7f2-905d83cf50f1 response_code = 200 uri = /v2p
19532024-08-03T04:42:37.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58805
19542024-08-03T04:42:37.853ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
19552024-08-03T04:42:37.881ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
19562024-08-03T04:42:37.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 52497 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58805 req_id = 9ea11a73-badc-47b4-bb9e-aab246af1312 response_code = 204 uri = /switch-ports
19572024-08-03T04:42:37.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58805 req_id = abc7049c-98fe-4635-96a3-3654c3a952b0 response_code = 200 uri = /network-bootstore-config
19582024-08-03T04:42:38.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61120
19592024-08-03T04:42:38.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61120 req_id = b1b2218c-c112-4dd8-a583-1e6962d25aff response_code = 200 uri = /vpc-routes
19602024-08-03T04:42:38.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61120 req_id = 41f487ae-f7bd-4528-9780-2c8a1bd4dec7 response_code = 204 uri = /vpc-routes
19612024-08-03T04:42:38.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34277
19622024-08-03T04:42:38.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34277 req_id = 141e4394-b080-4386-aa93-b290252ee31a response_code = 200 uri = /v2p
19632024-08-03T04:42:38.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44464
19642024-08-03T04:42:38.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44464 req_id = 7199d271-d095-4f83-8e98-3e74bdde318c response_code = 200 uri = /v2p
19652024-08-03T04:42:38.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46832
19662024-08-03T04:42:38.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46832 req_id = ed78327d-159f-406d-9250-3e57a656e2be response_code = 200 uri = /vpc-routes
19672024-08-03T04:42:38.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 605 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46832 req_id = 24fc226e-d1f8-4db5-b378-9b35fdcd5546 response_code = 204 uri = /vpc-routes
19682024-08-03T04:42:38.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39784
19692024-08-03T04:42:38.264ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
19702024-08-03T04:42:38.291ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
19712024-08-03T04:42:38.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 48500 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39784 req_id = 4529c1d9-f491-4068-a7cd-f76706517738 response_code = 204 uri = /switch-ports
19722024-08-03T04:42:38.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39784 req_id = 9bbdda68-2da9-4580-8d28-a9e66e848460 response_code = 200 uri = /network-bootstore-config
19732024-08-03T04:42:38.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59808
19742024-08-03T04:42:38.347ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
19752024-08-03T04:42:38.371ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
19762024-08-03T04:42:38.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 45660 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59808 req_id = 319e59a7-8ad5-44fb-841d-8fc24ba801e2 response_code = 204 uri = /switch-ports
19772024-08-03T04:42:38.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 744 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59808 req_id = f2a08bc1-54c5-49e3-b976-36c710641589 response_code = 200 uri = /network-bootstore-config
19782024-08-03T04:42:42.679ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1081 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = d0091cf4-d789-4d43-9313-6c115c23d132 response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
19792024-08-03T04:42:54.986ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54277
19802024-08-03T04:42:54.986ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 85 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54277 req_id = 85377954-e5fb-4797-9f75-e1b12cc69eff response_code = 200 uri = /baseboard
19812024-08-03T04:43:07.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36598
19822024-08-03T04:43:07.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36598 req_id = ca2b9baa-b984-4455-9ed6-c838e6f2d955 response_code = 200 uri = /v2p
19832024-08-03T04:43:07.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51332
19842024-08-03T04:43:07.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51332 req_id = 33c5e9c1-cb5d-4976-bab4-f35689ce008b response_code = 200 uri = /vpc-routes
19852024-08-03T04:43:07.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51332 req_id = 31796acc-338e-4a66-9fee-5d3bd399d8e9 response_code = 204 uri = /vpc-routes
19862024-08-03T04:43:08.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64503
19872024-08-03T04:43:08.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64503 req_id = 44675543-6241-4686-9c58-45842f9b2839 response_code = 200 uri = /vpc-routes
19882024-08-03T04:43:08.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33641
19892024-08-03T04:43:08.078ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
19902024-08-03T04:43:08.108ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
19912024-08-03T04:43:08.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 56981 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33641 req_id = 2dd6680b-731c-433e-8dff-e04dd0cd13b1 response_code = 204 uri = /switch-ports
19922024-08-03T04:43:08.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64503 req_id = 8660c43a-be54-46e7-a5da-cd8479af77a4 response_code = 204 uri = /vpc-routes
19932024-08-03T04:43:08.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42130
19942024-08-03T04:43:08.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42130 req_id = cba88b76-2ae2-4232-af54-f481f949b282 response_code = 200 uri = /v2p
19952024-08-03T04:43:08.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33641 req_id = b7c72462-bb90-487f-8f40-094e5d77173c response_code = 200 uri = /network-bootstore-config
19962024-08-03T04:43:08.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45352
19972024-08-03T04:43:08.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45352 req_id = 21ac706e-9c5b-4e1e-90b0-fa833ba8749e response_code = 200 uri = /vpc-routes
19982024-08-03T04:43:08.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45352 req_id = 096c1c8d-aca4-411a-bb2b-dde9f6f49966 response_code = 204 uri = /vpc-routes
19992024-08-03T04:43:08.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39962
20002024-08-03T04:43:08.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39962 req_id = eb755d11-31cc-46b1-bcdb-50845d84270f response_code = 200 uri = /v2p
20012024-08-03T04:43:08.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36582
20022024-08-03T04:43:08.346ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
20032024-08-03T04:43:08.370ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
20042024-08-03T04:43:08.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 46562 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36582 req_id = 7651e5bd-81db-4b4f-b5e9-954e86e221be response_code = 204 uri = /switch-ports
20052024-08-03T04:43:08.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36582 req_id = 91cc37d2-2c33-44dc-8c0f-e1ccaeadcace response_code = 200 uri = /network-bootstore-config
20062024-08-03T04:43:08.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45417
20072024-08-03T04:43:08.540ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
20082024-08-03T04:43:08.566ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
20092024-08-03T04:43:08.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 48217 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45417 req_id = 5ed28691-9b72-4aa2-bf20-8843554210f2 response_code = 204 uri = /switch-ports
20102024-08-03T04:43:08.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45417 req_id = fb91b7da-8015-4199-9793-5f288b596127 response_code = 200 uri = /network-bootstore-config
20112024-08-03T04:43:12.679ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 588 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = 7960c0c9-25db-4217-be10-8bdfcbaa7953 response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
20122024-08-03T04:43:25.020ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53086
20132024-08-03T04:43:25.020ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 64 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53086 req_id = 1043d42d-02e5-430b-96d3-17fc45a3dfe4 response_code = 200 uri = /baseboard
20142024-08-03T04:43:37.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56862
20152024-08-03T04:43:37.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56862 req_id = 4c64ed95-5e41-492f-892d-399b24ade348 response_code = 200 uri = /vpc-routes
20162024-08-03T04:43:37.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56862 req_id = 020a5cda-a667-48a1-9196-6858cdfac746 response_code = 204 uri = /vpc-routes
20172024-08-03T04:43:37.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47356
20182024-08-03T04:43:37.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47356 req_id = 9b23e920-37b0-4a5d-8f54-c94f768c4732 response_code = 200 uri = /v2p
20192024-08-03T04:43:37.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55032
20202024-08-03T04:43:37.836ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
20212024-08-03T04:43:37.862ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
20222024-08-03T04:43:37.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 49262 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55032 req_id = 9bb3fdb1-ef46-495d-afad-a4c16d7b4591 response_code = 204 uri = /switch-ports
20232024-08-03T04:43:37.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 639 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55032 req_id = 652e136c-8f78-4cf6-bdde-6b820efd1f7e response_code = 200 uri = /network-bootstore-config
20242024-08-03T04:43:38.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56125
20252024-08-03T04:43:38.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56125 req_id = ddfff6d7-0e9c-4bc2-be14-f1dfd4bbad72 response_code = 200 uri = /vpc-routes
20262024-08-03T04:43:38.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43138
20272024-08-03T04:43:38.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 894 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43138 req_id = 7316ebcf-f848-40c4-bb18-20210779cc2c response_code = 200 uri = /v2p
20282024-08-03T04:43:38.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56125 req_id = c568d95f-8a8b-46c5-81f0-19a45d9bdfde response_code = 204 uri = /vpc-routes
20292024-08-03T04:43:38.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64543
20302024-08-03T04:43:38.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64543 req_id = 3229c761-d589-4047-a4a6-794a68a04e24 response_code = 200 uri = /vpc-routes
20312024-08-03T04:43:38.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37998
20322024-08-03T04:43:38.232ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
20332024-08-03T04:43:38.259ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
20342024-08-03T04:43:38.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 53059 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37998 req_id = 5c207a35-08d2-4df0-b464-6cf2b78b4093 response_code = 204 uri = /switch-ports
20352024-08-03T04:43:38.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64543 req_id = ed08398d-fcfb-43a7-9d36-84ffdf3e4295 response_code = 204 uri = /vpc-routes
20362024-08-03T04:43:38.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37998 req_id = 3801b614-f9dd-4623-b7d8-00a798a86fe3 response_code = 200 uri = /network-bootstore-config
20372024-08-03T04:43:38.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63614
20382024-08-03T04:43:38.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 720 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63614 req_id = 13b589a0-7390-4c86-a960-506117e7cf4b response_code = 200 uri = /v2p
20392024-08-03T04:43:38.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54227
20402024-08-03T04:43:38.403ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
20412024-08-03T04:43:38.430ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
20422024-08-03T04:43:38.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 51164 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54227 req_id = a3b22fb7-4908-42c2-bc26-5c6ef472c8a5 response_code = 204 uri = /switch-ports
20432024-08-03T04:43:38.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54227 req_id = 1e92d671-98ac-401a-9f12-e1d4d9cb24e0 response_code = 200 uri = /network-bootstore-config
20442024-08-03T04:43:42.680ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1079 local_addr = [fd00:1122:3344:101::1]:52786 method = GET remote_addr = [fd00:1122:3344:101::d]:33429 req_id = e1382f88-ad9a-49da-9511-09889df78bd3 response_code = 200 sled_id = efa65cdf-dd3f-49ef-9fee-7f962aef90ca uri = /efa65cdf-dd3f-49ef-9fee-7f962aef90ca
20452024-08-03T04:43:45.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51104
20462024-08-03T04:43:45.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51104 req_id = 8800f079-071f-4169-8fc8-f0e889a0e8fd response_code = 200 uri = /v2p
20472024-08-03T04:43:45.116ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:780 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 245, 107, 194])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(7837399) }
20482024-08-03T04:43:45.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 2017 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51104 req_id = 1bc4f2f5-4f85-45f1-b15b-1e10b04612e0 response_code = 204 uri = /v2p
20492024-08-03T04:43:45.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42516
20502024-08-03T04:43:45.290ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:592 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: f72a6e5e-d952-467e-b266-1cc4b758e25f, kind: Instance { id: 42863d1f-da84-4c54-93ab-c58e99289a53 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 245, 107, 194])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7837399), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f72a6e5e-d952-467e-b266-1cc4b758e25f, kind: Instance { id: 42863d1f-da84-4c54-93ab-c58e99289a53 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 245, 107, 194])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7837399), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f72a6e5e-d952-467e-b266-1cc4b758e25f, kind: Instance { id: 42863d1f-da84-4c54-93ab-c58e99289a53 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 245, 107, 194])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7837399), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(7837399))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f72a6e5e-d952-467e-b266-1cc4b758e25f, kind: Instance { id: 42863d1f-da84-4c54-93ab-c58e99289a53 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 245, 107, 194])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7837399), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-e22461e698a", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 3238c59c-4c82-4e15-817b-009166bbbd59, read_only_parent: Some(Volume { block_size: 512, id: d420aec8-d064-45b5-bdba-a182d2af9796, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3a1aea1c-22c7-4953-a6f7-d52d26fef3ef, key: Some("YsmfZEskhvIt5dMAQOX150Krc/oTMsuQ1qZWdZdgQH0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::1a]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3238c59c-4c82-4e15-817b-009166bbbd59, key: Some("YeBlZQXvqtXaa5aZrC7n50hXWmR4FiSC0x3Fmk2BYfA="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19003", "[fd00:1122:3344:101::19]:19000", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAB8diUDWQNZAAB2JQNZAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAfHYlA1kDWQAAdiUDWQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI0Mjg2M2QxZi1kYTg0LTRjNTQtOTNhYi1jNThlOTkyODlhNTMiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQXBOeDhkTGtOYzJQbWFtbEprZitzRk0wa0lldWN2QW5ISFBvdlBvZXlrbCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 instance_runtime = InstanceRuntimeState { propolis_id: Some(1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-08-03T04:43:44.889244324Z } metadata = InstanceMetadata { silo_id: 30a377ee-81e6-4742-903e-32792c4eff0d, project_id: a86395b6-76e2-4f2c-ab0c-bae070536014 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 1d89ada8-da06-48eb-8196-3826e74c8f08 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-08-03T04:43:44.836725Z }
20512024-08-03T04:43:45.290ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:626 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 (instance)
20522024-08-03T04:43:45.290ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:992 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 propolis_id = 1d89ada8-da06-48eb-8196-3826e74c8f08 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: f72a6e5e-d952-467e-b266-1cc4b758e25f, kind: Instance { id: 42863d1f-da84-4c54-93ab-c58e99289a53 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 245, 107, 194])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7837399), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f72a6e5e-d952-467e-b266-1cc4b758e25f, kind: Instance { id: 42863d1f-da84-4c54-93ab-c58e99289a53 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 245, 107, 194])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7837399), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f72a6e5e-d952-467e-b266-1cc4b758e25f, kind: Instance { id: 42863d1f-da84-4c54-93ab-c58e99289a53 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 245, 107, 194])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7837399), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(7837399))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f72a6e5e-d952-467e-b266-1cc4b758e25f, kind: Instance { id: 42863d1f-da84-4c54-93ab-c58e99289a53 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 245, 107, 194])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(7837399), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-e22461e698a", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 3238c59c-4c82-4e15-817b-009166bbbd59, read_only_parent: Some(Volume { block_size: 512, id: d420aec8-d064-45b5-bdba-a182d2af9796, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3a1aea1c-22c7-4953-a6f7-d52d26fef3ef, key: Some("YsmfZEskhvIt5dMAQOX150Krc/oTMsuQ1qZWdZdgQH0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::1a]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3238c59c-4c82-4e15-817b-009166bbbd59, key: Some("YeBlZQXvqtXaa5aZrC7n50hXWmR4FiSC0x3Fmk2BYfA="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19003", "[fd00:1122:3344:101::19]:19000", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAB8diUDWQNZAAB2JQNZAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAfHYlA1kDWQAAdiUDWQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI0Mjg2M2QxZi1kYTg0LTRjNTQtOTNhYi1jNThlOTkyODlhNTMiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQXBOeDhkTGtOYzJQbWFtbEprZitzRk0wa0lldWN2QW5ISFBvdlBvZXlrbCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-08-03T04:43:44.889244324Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-08-03T04:43:44.836725Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
20532024-08-03T04:43:45.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 9406 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42516 req_id = 73f9d751-bb1d-419f-adef-efcdfc16aca4 response_code = 200 uri = /instances/42863d1f-da84-4c54-93ab-c58e99289a53
20542024-08-03T04:43:45.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53206
20552024-08-03T04:43:45.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1782 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53206 req_id = 1ad8b75c-b83c-4b4b-b20e-2d68ab1e9e71 response_code = 200 uri = /instances/42863d1f-da84-4c54-93ab-c58e99289a53/state
20562024-08-03T04:43:45.411ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 245, 107, 194]), slot: 0, vni: Vni { inner: 7837399 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
20572024-08-03T04:43:45.412ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
20582024-08-03T04:43:45.450ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08 file = illumos-utils/src/zone.rs:316 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20592024-08-03T04:43:45.473ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08 file = illumos-utils/src/zone.rs:354 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20602024-08-03T04:43:46.791ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20612024-08-03T04:43:46.792ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08 zone file = illumos-utils/src/running_zone.rs:472 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 zone = oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08
20622024-08-03T04:43:46.971ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 53.440155ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 zone = oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08
20632024-08-03T04:43:47.038ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 61.207751ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 zone = oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08
20642024-08-03T04:43:47.117ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 155.403843ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 zone = oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08
20652024-08-03T04:43:47.289ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 429.733949ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 zone = oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08
20662024-08-03T04:43:47.734ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 1.106859495s file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 zone = oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08
20672024-08-03T04:43:48.853ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 820.872001ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 zone = oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08
20682024-08-03T04:43:49.685ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 802.469997ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 zone = oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08
20692024-08-03T04:43:50.498ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 719.347889ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 zone = oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08
20702024-08-03T04:43:51.227ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 875.866959ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 zone = oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08
20712024-08-03T04:43:52.130ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08 file = sled-agent/src/instance.rs:1490 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20722024-08-03T04:43:52.139ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 45.938357ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20732024-08-03T04:43:52.195ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 58.187486ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20742024-08-03T04:43:52.262ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 152.732505ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20752024-08-03T04:43:52.424ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08") failed: Property not found. retry in 221.365979ms file = illumos-utils/src/svc.rs:36 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20762024-08-03T04:43:52.656ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1499 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20772024-08-03T04:43:52.692ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1513 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20782024-08-03T04:43:52.694ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAB8diUDWQNZAAB2JQNZAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAfHYlA1kDWQAAdiUDWQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI0Mjg2M2QxZi1kYTg0LTRjNTQtOTNhYi1jNThlOTkyODlhNTMiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQXBOeDhkTGtOYzJQbWFtbEprZitzRk0wa0lldWN2QW5ISFBvdlBvZXlrbCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-e22461e698a", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 3238c59c-4c82-4e15-817b-009166bbbd59, read_only_parent: Some(Volume { block_size: 512, id: d420aec8-d064-45b5-bdba-a182d2af9796, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3a1aea1c-22c7-4953-a6f7-d52d26fef3ef, key: Some("YsmfZEskhvIt5dMAQOX150Krc/oTMsuQ1qZWdZdgQH0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::1a]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3238c59c-4c82-4e15-817b-009166bbbd59, key: Some("YeBlZQXvqtXaa5aZrC7n50hXWmR4FiSC0x3Fmk2BYfA="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19003", "[fd00:1122:3344:101::19]:19000", "[fd00:1122:3344:101::14]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "opte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: 42863d1f-da84-4c54-93ab-c58e99289a53, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: a86395b6-76e2-4f2c-ab0c-bae070536014, silo_id: 30a377ee-81e6-4742-903e-32792c4eff0d, sled_id: efa65cdf-dd3f-49ef-9fee-7f962aef90ca, sled_model: "i86pc", sled_revision: 0, sled_serial: "buskin" }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:736 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20792024-08-03T04:43:52.833ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:738 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20802024-08-03T04:43:52.835ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_status: NoMigration, time: 2024-08-03T04:43:52.835393413Z } file = sled-agent/src/instance.rs:622 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20812024-08-03T04:43:52.835ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:644 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 new_instance_state = InstanceRuntimeState { propolis_id: Some(1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-08-03T04:43:44.889244324Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-03T04:43:52.835393413Z } propolis_id = 1d89ada8-da06-48eb-8196-3826e74c8f08
20822024-08-03T04:43:52.836ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:541 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-08-03T04:43:44.889244324Z }, propolis_id: 1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis), vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-03T04:43:52.835393413Z }, migration_state: None }
20832024-08-03T04:43:52.925ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-08-03T04:43:52.925268810Z } file = sled-agent/src/instance.rs:622 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20842024-08-03T04:43:52.925ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:644 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 new_instance_state = InstanceRuntimeState { propolis_id: Some(1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-08-03T04:43:44.889244324Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-03T04:43:52.925268810Z } propolis_id = 1d89ada8-da06-48eb-8196-3826e74c8f08
20852024-08-03T04:43:52.925ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:541 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-08-03T04:43:44.889244324Z }, propolis_id: 1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis), vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-03T04:43:52.925268810Z }, migration_state: None }
20862024-08-03T04:43:52.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58375
20872024-08-03T04:43:52.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 642 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58375 req_id = 94ca0ffc-a933-4182-bb09-5bd703c94edd response_code = 200 uri = /vpc-routes
20882024-08-03T04:43:53.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 395 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58375 req_id = 69ffb781-0b05-4123-af06-1aab3c3877ff response_code = 204 uri = /vpc-routes
20892024-08-03T04:43:53.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60437
20902024-08-03T04:43:53.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60437 req_id = 415f5186-531e-4960-abf0-1a0706afb026 response_code = 200 uri = /vpc-routes
20912024-08-03T04:43:53.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60437 req_id = 904f7afe-03b0-4365-a7a8-25ab60027b4f response_code = 204 uri = /vpc-routes
20922024-08-03T04:43:55.055ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36134
20932024-08-03T04:43:55.055ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36134 req_id = 776ba278-b602-4966-8b40-9bda29ddf2a0 response_code = 200 uri = /baseboard
20942024-08-03T04:44:02.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38363
20952024-08-03T04:44:02.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 789 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38363 req_id = 6d6f3a3f-786d-4a63-9470-ebd0908eca41 response_code = 200 uri = /instances/42863d1f-da84-4c54-93ab-c58e99289a53/state
20962024-08-03T04:44:02.876ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-08-03T04:44:02.876243101Z } file = sled-agent/src/instance.rs:622 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
20972024-08-03T04:44:02.876ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:644 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 new_instance_state = InstanceRuntimeState { propolis_id: Some(1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-08-03T04:43:44.889244324Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-03T04:44:02.876243101Z } propolis_id = 1d89ada8-da06-48eb-8196-3826e74c8f08
20982024-08-03T04:44:02.876ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:541 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-08-03T04:43:44.889244324Z }, propolis_id: 1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis), vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-03T04:44:02.876243101Z }, migration_state: None }
20992024-08-03T04:44:02.951ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-08-03T04:44:02.951160517Z } file = sled-agent/src/instance.rs:622 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
21002024-08-03T04:44:02.951ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:644 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-08-03T04:44:02.951160517Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-08-03T04:44:02.951160517Z } propolis_id = 1d89ada8-da06-48eb-8196-3826e74c8f08
21012024-08-03T04:44:02.951ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:659 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
21022024-08-03T04:44:02.951ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
21032024-08-03T04:44:02.953ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
21042024-08-03T04:44:02.954ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/16e1fbb7-6638-498f-9e1e-29640ce1133e/debug/bundle/zone", "/pool/int/b5d91234-7a79-49d2-a89a-3bda4b110fe1/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/46278603-ed5b-4e1e-8790-ff33bffa4ceb/crypt/debug", "/pool/ext/67739d5d-424d-405e-8a3a-6c20313bdaf6/crypt/debug", "/pool/ext/01ed0023-10bb-4905-bb62-ccce58715666/crypt/debug", "/pool/ext/13d2cb16-058b-4197-b952-c7814b2cff2c/crypt/debug", "/pool/ext/38797675-2946-44e6-bde7-79f0880ee086/crypt/debug", "/pool/ext/ec22abdc-76d0-4dce-9241-6d7acac56c81/crypt/debug", "/pool/ext/2d57b90c-5604-40fb-87e1-361dc611bf9e/crypt/debug", "/pool/ext/77551b64-b476-4b28-ab7c-579a041315cc/crypt/debug", "/pool/ext/869fe861-6756-4391-9071-05e75ac72c2e/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:445 zone_name = oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08
21052024-08-03T04:44:02.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44607
21062024-08-03T04:44:02.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44607 req_id = 985ff7f2-7163-48d6-ba83-501f5ef22e6f response_code = 200 uri = /vpc-routes
21072024-08-03T04:44:03.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44607 req_id = 9320b999-3c3a-42f7-9354-64be16fb7d54 response_code = 204 uri = /vpc-routes
21082024-08-03T04:44:03.562ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1249 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08", bundle_id: 0ef53b09-9d4e-49ff-a788-ce8ee1f49e72 }, time_created: 2024-08-03T04:44:02.954589794Z, version: 0, cause: TerminatedInstance }
21092024-08-03T04:44:03.562ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_1d89ada8-da06-48eb-8196-3826e74c8f08 file = sled-agent/src/instance.rs:831 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
21102024-08-03T04:44:05.304ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:270 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
21112024-08-03T04:44:05.322ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:906 id = RouterId { vni: Vni(7837399), kind: System }
21122024-08-03T04:44:05.322ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:906 id = RouterId { vni: Vni(7837399), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
21132024-08-03T04:44:05.323ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:541 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-08-03T04:44:02.951160517Z }, propolis_id: 1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-03T04:44:05.323469130Z }, migration_state: None }
21142024-08-03T04:44:05.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34699
21152024-08-03T04:44:05.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 823 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34699 req_id = 2c7fb27a-54ee-4baa-bdf2-e099c04efd6c response_code = 200 uri = /v2p
21162024-08-03T04:44:05.412ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:780 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 245, 107, 194])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(7837399) }
21172024-08-03T04:44:05.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34699 req_id = c3156a4d-9419-4295-bfd7-e60eacab8ea6 response_code = 204 uri = /v2p
21182024-08-03T04:44:05.605ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:541 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-08-03T04:44:02.951160517Z }, propolis_id: 1d89ada8-da06-48eb-8196-3826e74c8f08 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-03T04:44:05.323469130Z }, migration_state: None }
21192024-08-03T04:44:05.609ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:774 instance_id = 42863d1f-da84-4c54-93ab-c58e99289a53
21202024-08-03T04:44:05.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59447
21212024-08-03T04:44:05.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59447 req_id = 45c1a0c6-7809-4250-ae97-f8dcb45d5813 response_code = 200 uri = /vpc-routes
21222024-08-03T04:44:05.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 770 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59447 req_id = 77e57f53-4a7e-4e9b-b9fb-85263f1b6ad6 response_code = 204 uri = /vpc-routes
21232024-08-03T04:44:05.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50900
21242024-08-03T04:44:05.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50900 req_id = e0f191a9-b902-40ec-b4bf-69256dc9b0a5 response_code = 200 uri = /vpc-routes
21252024-08-03T04:44:05.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50900 req_id = 5ee305c6-a9c0-47ef-a478-940690f9d5d2 response_code = 204 uri = /vpc-routes
21262024-08-03T04:44:05.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33195
21272024-08-03T04:44:05.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 1721 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33195 req_id = 94d4e4e8-f3e6-4683-b08c-b9d1fccf66d1 response_code = 200 uri = /v2p
21282024-08-03T04:44:05.847ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:820 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 245, 107, 194])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(7837399) }
21292024-08-03T04:44:05.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 763 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:33195 req_id = 6a98dac6-df1f-44dc-b485-e6f8cf97d7ca response_code = 204 uri = /v2p
21302024-08-03T04:44:06.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58750
21312024-08-03T04:44:06.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58750 req_id = ab742bff-6ff5-48ab-8bf5-fccbab31bb73 response_code = 200 uri = /vpc-routes
21322024-08-03T04:44:06.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58750 req_id = 0676974a-3cf3-4cb7-8a97-b4ae904e880f response_code = 204 uri = /vpc-routes
21332024-08-03T04:44:07.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64106
21342024-08-03T04:44:07.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64106 req_id = d2622766-ccb3-4415-bcf7-4e5f9e845c78 response_code = 200 uri = /vpc-routes
21352024-08-03T04:44:07.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64106 req_id = 4a5bc709-0aa6-433d-8398-63d10a4f8531 response_code = 204 uri = /vpc-routes
21362024-08-03T04:44:07.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38654
21372024-08-03T04:44:07.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38654 req_id = f93ec29e-8593-4f6d-90fc-04f799c91d7e response_code = 200 uri = /v2p
21382024-08-03T04:44:08.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47122
21392024-08-03T04:44:08.107ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
21402024-08-03T04:44:08.135ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
21412024-08-03T04:44:08.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 51246 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47122 req_id = 50291989-9b6b-46a4-927e-c8eb8e7d29ac response_code = 204 uri = /switch-ports
21422024-08-03T04:44:08.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47122 req_id = 03763a20-2019-4c44-89be-332a5930cba0 response_code = 200 uri = /network-bootstore-config
21432024-08-03T04:44:08.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64476
21442024-08-03T04:44:08.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64476 req_id = 0785c545-cd26-477c-8e04-f8676cd4c6e7 response_code = 200 uri = /vpc-routes
21452024-08-03T04:44:08.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64476 req_id = 51992d34-32bd-4009-ba23-de06971ebbef response_code = 204 uri = /vpc-routes
21462024-08-03T04:44:08.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59641
21472024-08-03T04:44:08.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59641 req_id = 4f2b9c1a-04fe-4bc5-91da-d4a13568a40e response_code = 200 uri = /v2p
21482024-08-03T04:44:08.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42557
21492024-08-03T04:44:08.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42557 req_id = 494ee460-3b97-433a-a85c-10825f94bcf2 response_code = 200 uri = /vpc-routes
21502024-08-03T04:44:08.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42557 req_id = fb30a28b-3856-461c-a3e7-8cb2a4376b68 response_code = 204 uri = /vpc-routes
21512024-08-03T04:44:08.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51237
21522024-08-03T04:44:08.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51237 req_id = 144dfee4-b046-4de1-b569-101ffe3004f2 response_code = 200 uri = /v2p
21532024-08-03T04:44:08.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33084
21542024-08-03T04:44:08.596ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
21552024-08-03T04:44:08.625ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
21562024-08-03T04:44:08.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 53200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33084 req_id = ed13e782-c49c-45ed-b777-e493711cb7e2 response_code = 204 uri = /switch-ports
21572024-08-03T04:44:08.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33084 req_id = 63077637-b1f1-40d8-b808-1d1dc34473b2 response_code = 200 uri = /network-bootstore-config
21582024-08-03T04:44:08.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59985
21592024-08-03T04:44:08.698ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3823
21602024-08-03T04:44:08.721ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3834
21612024-08-03T04:44:08.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 46685 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59985 req_id = 3c4d52f2-3618-4ae1-9d69-e9e22534a28f response_code = 204 uri = /switch-ports
21622024-08-03T04:44:08.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0c0bae3/dropshot/src/server.rs:914 latency_us = 575 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59985 req_id = 9782384f-5a35-41b0-af8d-9796edfca5d3 response_code = 200 uri = /network-bootstore-config