Max level shown:
1 [ Jul 25 02:07:01 Enabled. ]
2 [ Jul 25 02:07:01 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jul 25 02:07:01 Method "start" exited with status 0. ]
4 [ Jul 25 02:07:01 Rereading configuration. ]
5 [ Jul 25 02:07:01 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-07-25T02:07:01.403ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:110
82024-07-25T02:07:01.403ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-07-25T02:07:01.456ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-07-25T02:07:01.456ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-07-25T02:07:01.572ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-07-25T02:07:01.581ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-07-25T02:07:01.589ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-07-25T02:07:02.192ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-07-25T02:07:02.333ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:125
162024-07-25T02:07:02.333ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:137
172024-07-25T02:07:02.333ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:150
182024-07-25T02:07:02.333ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:172 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-07-25T02:07:02.333ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-07-25T02:07:02.333ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:716
212024-07-25T02:07:02.336ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:623
222024-07-25T02:07:02.336ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:765
232024-07-25T02:07:02.336ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:186
242024-07-25T02:07:02.336ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:824
252024-07-25T02:07:02.336ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/m2_0.vdev
262024-07-25T02:07:02.336ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-07-25T02:07:02.336ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
282024-07-25T02:07:02.336ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-07-25T02:07:02.336ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-07-25T02:07:02.348ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:360
312024-07-25T02:07:02.348ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool)
322024-07-25T02:07:02.471ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool), kind: Internal }
332024-07-25T02:07:02.706ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:405
342024-07-25T02:07:02.706ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/m2_1.vdev
352024-07-25T02:07:02.706ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-07-25T02:07:02.706ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-07-25T02:07:02.706ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
382024-07-25T02:07:02.706ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-07-25T02:07:02.706ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-07-25T02:07:02.715ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:360
412024-07-25T02:07:02.715ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool)
422024-07-25T02:07:02.821ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool), kind: Internal }
432024-07-25T02:07:03.046ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_0.vdev
442024-07-25T02:07:03.046ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-07-25T02:07:03.046ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
482024-07-25T02:07:03.046ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-07-25T02:07:03.046ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_1.vdev
502024-07-25T02:07:03.046ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-07-25T02:07:03.046ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
522024-07-25T02:07:03.046ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-07-25T02:07:03.046ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_2.vdev
562024-07-25T02:07:03.046ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-07-25T02:07:03.046ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
582024-07-25T02:07:03.046ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-07-25T02:07:03.046ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_3.vdev
622024-07-25T02:07:03.046ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-07-25T02:07:03.046ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
642024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
652024-07-25T02:07:03.046ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
662024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-07-25T02:07:03.046ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_4.vdev
682024-07-25T02:07:03.046ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-07-25T02:07:03.046ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
722024-07-25T02:07:03.046ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-07-25T02:07:03.046ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_5.vdev
742024-07-25T02:07:03.046ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-07-25T02:07:03.046ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
782024-07-25T02:07:03.046ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-07-25T02:07:03.046ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_6.vdev
802024-07-25T02:07:03.046ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
812024-07-25T02:07:03.046ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-07-25T02:07:03.046ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-07-25T02:07:03.046ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_7.vdev
842024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852024-07-25T02:07:03.046ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862024-07-25T02:07:03.046ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
872024-07-25T02:07:03.046ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-07-25T02:07:03.046ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:242 vdev = /scratch/u2_8.vdev
892024-07-25T02:07:03.046ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:405
902024-07-25T02:07:03.046ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
912024-07-25T02:07:03.046ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
922024-07-25T02:07:03.047ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-07-25T02:07:03.047ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-07-25T02:07:03.047ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:96
952024-07-25T02:07:03.047ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:98
962024-07-25T02:07:03.047ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
972024-07-25T02:07:03.047ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
982024-07-25T02:07:03.047ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
992024-07-25T02:07:03.047ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1002024-07-25T02:07:03.047ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:210
1012024-07-25T02:07:03.047ZINFOSledAgent (bootstore): No ledger in /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1022024-07-25T02:07:03.047ZINFOSledAgent (bootstore): No ledger in /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1032024-07-25T02:07:03.047ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1042024-07-25T02:07:03.047ZINFOSledAgent (bootstore): No ledger in /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-07-25T02:07:03.047ZINFOSledAgent (bootstore): No ledger in /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-07-25T02:07:03.047ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1072024-07-25T02:07:03.047ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:215
1082024-07-25T02:07:03.047ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:230
1092024-07-25T02:07:03.057ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:722
1102024-07-25T02:07:03.057ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:292 next_cleanup = Instant { tv_sec: 1281, tv_nsec: 138802411 } time_to_next_cleanup = 599.999912359s
1112024-07-25T02:07:03.058ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3665
1122024-07-25T02:07:03.058ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1132024-07-25T02:07:03.058ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/sled-agent-request.json file = common/src/ledger.rs:188
1142024-07-25T02:07:03.058ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/sled-agent-request.json file = common/src/ledger.rs:188
1152024-07-25T02:07:03.061ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:205 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1162024-07-25T02:07:03.061ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1172024-07-25T02:07:03.061ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1017
1182024-07-25T02:07:03.061ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1192024-07-25T02:07:03.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1202024-07-25T02:07:03.061ZINFOSledAgent (RSS): No ledger in /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1212024-07-25T02:07:03.061ZINFOSledAgent (RSS): No ledger in /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1222024-07-25T02:07:03.061ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1077
1232024-07-25T02:07:03.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1242024-07-25T02:07:03.061ZINFOSledAgent (RSS): No ledger in /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/rss-sled-plan.json file = common/src/ledger.rs:188
1252024-07-25T02:07:03.061ZINFOSledAgent (RSS): No ledger in /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/rss-sled-plan.json file = common/src/ledger.rs:188
1262024-07-25T02:07:03.061ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1118
1272024-07-25T02:07:03.061ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1282024-07-25T02:07:03.061ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1292024-07-25T02:07:03.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1302024-07-25T02:07:03.061ZINFOSledAgent (RSS): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1312024-07-25T02:07:03.062ZINFOSledAgent (RSS): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1322024-07-25T02:07:03.062ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:176
1332024-07-25T02:07:03.062ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1151
1342024-07-25T02:07:03.062ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1352024-07-25T02:07:03.062ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1362024-07-25T02:07:03.062ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372024-07-25T02:07:03.063ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1382024-07-25T02:07:03.063ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 95f9e969-8f6f-4c75-9a0a-2e70695a1940, rack_id: 825b5b0d-f19c-424b-b303-3d278997ebd5, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1392024-07-25T02:07:03.063ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:47358
1402024-07-25T02:07:03.063ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 95f9e969-8f6f-4c75-9a0a-2e70695a1940, rack_id: 825b5b0d-f19c-424b-b303-3d278997ebd5, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:359
1412024-07-25T02:07:03.063ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:374
1422024-07-25T02:07:03.063ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:405
1432024-07-25T02:07:03.063ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1442024-07-25T02:07:03.063ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:573
1452024-07-25T02:07:03.063ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1462024-07-25T02:07:03.063ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1472024-07-25T02:07:03.063ZINFOSledAgent (StorageManager): No ledger in /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1482024-07-25T02:07:03.063ZINFOSledAgent (StorageManager): No ledger in /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1492024-07-25T02:07:03.063ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:562
1502024-07-25T02:07:03.063ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:590
1512024-07-25T02:07:03.063ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:394
1522024-07-25T02:07:03.063ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:374
1532024-07-25T02:07:03.063ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:480 result = DisksManagementResult { status: [] }
1542024-07-25T02:07:03.065ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3899
1552024-07-25T02:07:03.065ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4272
1562024-07-25T02:07:03.095ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1572024-07-25T02:07:03.116ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:316
1582024-07-25T02:07:03.133ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1592024-07-25T02:07:03.141ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:368 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
1602024-07-25T02:07:03.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
1612024-07-25T02:07:03.141ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:380 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
1622024-07-25T02:07:03.141ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1632024-07-25T02:07:03.145ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 100.005585ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "494439b8-67ac-474b-8ab0-a4565223ff9d", "content-length": "124", "date": "Thu, 25 Jul 2024 02:07:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "494439b8-67ac-474b-8ab0-a4565223ff9d" } file = clients/ddm-admin-client/src/lib.rs:177
1642024-07-25T02:07:03.154ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1652024-07-25T02:07:03.184ZINFOSledAgent: successfully created encrypted zvol: name="oxi_ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1662024-07-25T02:07:03.184ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/swap" file = sled-agent/src/swap_device.rs:96
1672024-07-25T02:07:03.189ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:395 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
1682024-07-25T02:07:03.189ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1692024-07-25T02:07:03.189ZINFOSledAgent (BackingFs): Ensuring dataset oxi_ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/backing/fmd file = sled-agent/src/backing_fs.rs:136
1702024-07-25T02:07:03.246ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-07-25T02:07:03.247ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 108.274731ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b641aec9-a7a4-4201-978b-19d5160744f7", "content-length": "124", "date": "Thu, 25 Jul 2024 02:07:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b641aec9-a7a4-4201-978b-19d5160744f7" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-07-25T02:07:03.266ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1732024-07-25T02:07:03.356ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1742024-07-25T02:07:03.357ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 174.020217ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "11f47198-ac95-4ad1-88e2-1f30c7ad4be6", "content-length": "124", "date": "Thu, 25 Jul 2024 02:07:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "11f47198-ac95-4ad1-88e2-1f30c7ad4be6" } file = clients/ddm-admin-client/src/lib.rs:177
1752024-07-25T02:07:03.486ZINFOSledAgent (BackingFs): Mounting oxi_ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1762024-07-25T02:07:03.499ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1772024-07-25T02:07:03.499ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1782024-07-25T02:07:03.499ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1792024-07-25T02:07:03.499ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1802024-07-25T02:07:03.532ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1812024-07-25T02:07:03.533ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 218.277944ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "410dbd68-3e8e-425c-aac3-32859378abc6", "content-length": "124", "date": "Thu, 25 Jul 2024 02:07:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "410dbd68-3e8e-425c-aac3-32859378abc6" } file = clients/ddm-admin-client/src/lib.rs:177
1822024-07-25T02:07:03.752ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-07-25T02:07:03.753ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 136.491731ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c355673a-33c0-4ed3-9b37-a8d1cc39e61c", "content-length": "124", "date": "Thu, 25 Jul 2024 02:07:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c355673a-33c0-4ed3-9b37-a8d1cc39e61c" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-07-25T02:07:03.890ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1852024-07-25T02:07:03.891ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 143.60476ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "65abfc06-0829-44d5-b73c-aca6369fbf19", "content-length": "124", "date": "Thu, 25 Jul 2024 02:07:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "65abfc06-0829-44d5-b73c-aca6369fbf19" } file = clients/ddm-admin-client/src/lib.rs:177
1862024-07-25T02:07:04.035ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-07-25T02:07:04.035ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 354.091951ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "009d6ec4-133e-4a19-89f3-07ccd78cdd6a", "content-length": "124", "date": "Thu, 25 Jul 2024 02:07:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "009d6ec4-133e-4a19-89f3-07ccd78cdd6a" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-07-25T02:07:04.227ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
1892024-07-25T02:07:04.228ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:40117 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
1902024-07-25T02:07:04.228ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
1912024-07-25T02:07:04.228ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:40117 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
1922024-07-25T02:07:04.229ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 333.138306ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
1932024-07-25T02:07:04.274ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
1942024-07-25T02:07:04.274ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
1952024-07-25T02:07:04.274ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:905 underlay_address = fd00:1122:3344:101::1
1962024-07-25T02:07:04.274ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1972024-07-25T02:07:04.275ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:12345
1982024-07-25T02:07:04.275ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:429
1992024-07-25T02:07:04.275ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2002024-07-25T02:07:04.275ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2012024-07-25T02:07:04.275ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2022024-07-25T02:07:04.275ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2032024-07-25T02:07:04.275ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
2042024-07-25T02:07:04.275ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3665
2052024-07-25T02:07:04.275ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:47358
2062024-07-25T02:07:04.469ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2072024-07-25T02:07:04.469ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2082024-07-25T02:07:04.469ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2092024-07-25T02:07:04.469ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2102024-07-25T02:07:04.469ZINFOSledAgent (RSS): No ledger in /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2112024-07-25T02:07:04.469ZINFOSledAgent (RSS): No ledger in /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2122024-07-25T02:07:04.469ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2132024-07-25T02:07:04.469ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2142024-07-25T02:07:04.483ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:600 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2152024-07-25T02:07:04.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57068
2162024-07-25T02:07:04.501ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2172024-07-25T02:07:04.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57068 req_id = 1799034d-a3d1-46b0-875f-d37ab7f2ce97 response_code = 200 uri = /inventory
2182024-07-25T02:07:04.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63030
2192024-07-25T02:07:04.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63030 req_id = 12474ff2-0bb8-4b5c-a87c-7971a08b277a response_code = 200 uri = /sled-role
2202024-07-25T02:07:04.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
2212024-07-25T02:07:04.531ZINFOSledAgent (RSS): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2222024-07-25T02:07:04.532ZINFOSledAgent (RSS): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2232024-07-25T02:07:04.532ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:830
2242024-07-25T02:07:04.563ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: da56297f-8f12-4189-a146-b98e840b92c5, pool_id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 591bbf76-8d9e-4b87-a28d-eeae816f80e0, pool_id: e6466883-5708-491f-861b-b8c70eb06724 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 371772f0-0c18-4188-9aa5-d5dcff2052da, pool_id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: e8fe59dc-186d-41ad-b7eb-653e31d372d0, pool_id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 96527ee0-12e5-43ec-acbd-1fc913f49b0d, pool_id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: c3ae07cd-603c-48fc-be64-779ec7f09583, pool_id: 86b20be7-f0a0-4768-ad5c-f79c894a12e5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: f3f62014-f6c3-4c45-8754-3a1d199e43c0, pool_id: 62718cfa-f65c-449a-866d-96573f2e371b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 32d6861e-7c8d-437f-a6c0-c985e8a70a7d, pool_id: 8bf94d57-ddf0-47ad-9696-adda8a5ae3ee (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 72fb670e-a66d-4da8-8a05-131900daf8df, pool_id: d6b0bc68-da4e-43d7-b225-9edbd58635b0 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:355 sled_address = [fd00:1122:3344:101::1]:12345
2252024-07-25T02:07:04.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34314
2262024-07-25T02:07:04.564ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 696.850098ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2272024-07-25T02:07:04.564ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:827 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2282024-07-25T02:07:04.564ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: da56297f-8f12-4189-a146-b98e840b92c5, pool_id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 591bbf76-8d9e-4b87-a28d-eeae816f80e0, pool_id: e6466883-5708-491f-861b-b8c70eb06724 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 371772f0-0c18-4188-9aa5-d5dcff2052da, pool_id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: e8fe59dc-186d-41ad-b7eb-653e31d372d0, pool_id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 96527ee0-12e5-43ec-acbd-1fc913f49b0d, pool_id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: c3ae07cd-603c-48fc-be64-779ec7f09583, pool_id: 86b20be7-f0a0-4768-ad5c-f79c894a12e5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: f3f62014-f6c3-4c45-8754-3a1d199e43c0, pool_id: 62718cfa-f65c-449a-866d-96573f2e371b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 32d6861e-7c8d-437f-a6c0-c985e8a70a7d, pool_id: 8bf94d57-ddf0-47ad-9696-adda8a5ae3ee (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 72fb670e-a66d-4da8-8a05-131900daf8df, pool_id: d6b0bc68-da4e-43d7-b225-9edbd58635b0 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:405
2292024-07-25T02:07:04.564ZINFOSledAgent (StorageManager): No ledger in /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2302024-07-25T02:07:04.564ZINFOSledAgent (StorageManager): No ledger in /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2312024-07-25T02:07:04.564ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:644 request = omicron_physical_disks_ensure
2322024-07-25T02:07:04.564ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:374
2332024-07-25T02:07:04.564ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:414
2342024-07-25T02:07:04.564ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
2352024-07-25T02:07:04.564ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2362024-07-25T02:07:04.698ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:360
2372024-07-25T02:07:04.698ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool)
2382024-07-25T02:07:05.317ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 513.591602ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2392024-07-25T02:07:05.317ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2402024-07-25T02:07:05.691ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }
2412024-07-25T02:07:05.845ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.93701752s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2422024-07-25T02:07:05.851ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:348
2432024-07-25T02:07:05.851ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:350
2442024-07-25T02:07:05.851ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:354
2452024-07-25T02:07:05.851ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:356
2462024-07-25T02:07:05.851ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2472024-07-25T02:07:05.851ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2482024-07-25T02:07:05.851ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
2492024-07-25T02:07:06.400ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2476
2502024-07-25T02:07:06.400ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2694
2512024-07-25T02:07:06.400ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2346
2522024-07-25T02:07:06.400ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2393
2532024-07-25T02:07:06.400ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2775
2542024-07-25T02:07:06.400ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2817
2552024-07-25T02:07:06.400ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:600 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2562024-07-25T02:07:06.401ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2572024-07-25T02:07:06.402ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2582024-07-25T02:07:06.585ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2619
2592024-07-25T02:07:06.587ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2387
2602024-07-25T02:07:06.587ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='137298a1-4370-4449-a4f2-2a00a0e90ecf'/> <propval type="astring" name="rack_id" value='825b5b0d-f19c-424b-b303-3d278997ebd5'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe09:50b7'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='95f9e969-8f6f-4c75-9a0a-2e70695a1940'/> <propval type="astring" name="rack_id" value='825b5b0d-f19c-424b-b303-3d278997ebd5'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='95f9e969-8f6f-4c75-9a0a-2e70695a1940'/> <propval type="astring" name="rack_uuid" value='825b5b0d-f19c-424b-b303-3d278997ebd5'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='95f9e969-8f6f-4c75-9a0a-2e70695a1940'/> <propval type="astring" name="rack_uuid" value='825b5b0d-f19c-424b-b303-3d278997ebd5'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2612024-07-25T02:07:06.588ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_switch
2622024-07-25T02:07:06.755ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_553fca36-adc1-4511-ade0-15a4f26d9fb9/crypt/zone file = sled-storage/src/dataset.rs:411
2632024-07-25T02:07:07.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 63.852648ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2642024-07-25T02:07:07.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 75.932126ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2652024-07-25T02:07:07.717ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2662024-07-25T02:07:08.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 153.986999ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2672024-07-25T02:07:08.635ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:600 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2682024-07-25T02:07:08.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 266.17562ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2692024-07-25T02:07:08.860ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.845472078s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2702024-07-25T02:07:08.860ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2712024-07-25T02:07:09.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.007658205s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2722024-07-25T02:07:10.014ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2732024-07-25T02:07:10.028ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_553fca36-adc1-4511-ade0-15a4f26d9fb9 file = sled-storage/src/dataset.rs:496
2742024-07-25T02:07:10.255ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:512
2752024-07-25T02:07:10.255ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:429
2762024-07-25T02:07:10.255ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:414
2772024-07-25T02:07:10.255ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
2782024-07-25T02:07:10.255ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2792024-07-25T02:07:10.491ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:360
2802024-07-25T02:07:10.491ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = e6466883-5708-491f-861b-b8c70eb06724 (zpool)
2812024-07-25T02:07:11.727ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }
2822024-07-25T02:07:11.965ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:348
2832024-07-25T02:07:11.965ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:350
2842024-07-25T02:07:11.965ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:354
2852024-07-25T02:07:11.965ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:356
2862024-07-25T02:07:11.965ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-07-25T02:07:11.965ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-07-25T02:07:11.965ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
2892024-07-25T02:07:12.486ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2902024-07-25T02:07:12.486ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:600 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2912024-07-25T02:07:13.238ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3923 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2922024-07-25T02:07:13.238ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3939
2932024-07-25T02:07:13.238ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:564 zone = oxz_switch
2942024-07-25T02:07:13.463ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952024-07-25T02:07:13.708ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2962024-07-25T02:07:13.714ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e6466883-5708-491f-861b-b8c70eb06724/crypt/zone file = sled-storage/src/dataset.rs:411
2972024-07-25T02:07:13.973ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:600 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2982024-07-25T02:07:14.920ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
2992024-07-25T02:07:14.922ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 6.213269613s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
3002024-07-25T02:07:14.922ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
3012024-07-25T02:07:15.015ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e6466883-5708-491f-861b-b8c70eb06724 file = sled-storage/src/dataset.rs:496
3022024-07-25T02:07:15.023ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:512
3032024-07-25T02:07:15.023ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:429
3042024-07-25T02:07:15.023ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:414
3052024-07-25T02:07:15.023ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3062024-07-25T02:07:15.023ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3072024-07-25T02:07:15.033ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:360
3082024-07-25T02:07:15.033ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = ef02fb81-56c7-4030-b314-3b86902902ba (zpool)
3092024-07-25T02:07:15.150ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }
3102024-07-25T02:07:15.158ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:348
3112024-07-25T02:07:15.158ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:350
3122024-07-25T02:07:15.158ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:354
3132024-07-25T02:07:15.158ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:356
3142024-07-25T02:07:15.158ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3152024-07-25T02:07:15.159ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3162024-07-25T02:07:15.159ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
3172024-07-25T02:07:15.203ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3182024-07-25T02:07:15.211ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ef02fb81-56c7-4030-b314-3b86902902ba/crypt/zone file = sled-storage/src/dataset.rs:411
3192024-07-25T02:07:15.352ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ef02fb81-56c7-4030-b314-3b86902902ba file = sled-storage/src/dataset.rs:496
3202024-07-25T02:07:15.360ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:512
3212024-07-25T02:07:15.360ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:429
3222024-07-25T02:07:15.360ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:414
3232024-07-25T02:07:15.360ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3242024-07-25T02:07:15.360ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3252024-07-25T02:07:15.371ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:360
3262024-07-25T02:07:15.371ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool)
3272024-07-25T02:07:15.485ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }
3282024-07-25T02:07:15.493ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:348
3292024-07-25T02:07:15.493ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:350
3302024-07-25T02:07:15.493ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:354
3312024-07-25T02:07:15.493ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:356
3322024-07-25T02:07:15.493ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3332024-07-25T02:07:15.493ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3342024-07-25T02:07:15.493ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
3352024-07-25T02:07:15.536ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3362024-07-25T02:07:15.544ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_07a306b8-24ae-4dbc-9694-d9d608dbd480/crypt/zone file = sled-storage/src/dataset.rs:411
3372024-07-25T02:07:15.689ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_07a306b8-24ae-4dbc-9694-d9d608dbd480 file = sled-storage/src/dataset.rs:496
3382024-07-25T02:07:15.697ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:512
3392024-07-25T02:07:15.697ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:429
3402024-07-25T02:07:15.697ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:414
3412024-07-25T02:07:15.697ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3422024-07-25T02:07:15.697ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3432024-07-25T02:07:15.707ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:360
3442024-07-25T02:07:15.707ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 38b79612-f102-46a4-a399-b1bc12efc31a (zpool)
3452024-07-25T02:07:15.824ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }
3462024-07-25T02:07:15.832ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:348
3472024-07-25T02:07:15.832ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:350
3482024-07-25T02:07:15.833ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:354
3492024-07-25T02:07:15.833ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:356
3502024-07-25T02:07:15.833ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3512024-07-25T02:07:15.833ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3522024-07-25T02:07:15.833ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
3532024-07-25T02:07:15.876ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3542024-07-25T02:07:15.884ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_38b79612-f102-46a4-a399-b1bc12efc31a/crypt/zone file = sled-storage/src/dataset.rs:411
3552024-07-25T02:07:15.925ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
3562024-07-25T02:07:15.968ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:600 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
3572024-07-25T02:07:16.036ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_38b79612-f102-46a4-a399-b1bc12efc31a file = sled-storage/src/dataset.rs:496
3582024-07-25T02:07:16.045ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:512
3592024-07-25T02:07:16.045ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:429
3602024-07-25T02:07:16.045ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:414
3612024-07-25T02:07:16.045ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3622024-07-25T02:07:16.045ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3632024-07-25T02:07:16.055ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:360
3642024-07-25T02:07:16.055ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 86b20be7-f0a0-4768-ad5c-f79c894a12e5 (zpool)
3652024-07-25T02:07:16.167ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 86b20be7-f0a0-4768-ad5c-f79c894a12e5 (zpool), kind: External }
3662024-07-25T02:07:16.175ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:348
3672024-07-25T02:07:16.175ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:350
3682024-07-25T02:07:16.175ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:354
3692024-07-25T02:07:16.175ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:356
3702024-07-25T02:07:16.175ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3712024-07-25T02:07:16.175ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3722024-07-25T02:07:16.175ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
3732024-07-25T02:07:16.220ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3742024-07-25T02:07:16.228ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_86b20be7-f0a0-4768-ad5c-f79c894a12e5/crypt/zone file = sled-storage/src/dataset.rs:411
3752024-07-25T02:07:16.377ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_86b20be7-f0a0-4768-ad5c-f79c894a12e5 file = sled-storage/src/dataset.rs:496
3762024-07-25T02:07:16.385ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:512
3772024-07-25T02:07:16.385ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:429
3782024-07-25T02:07:16.385ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:414
3792024-07-25T02:07:16.385ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3802024-07-25T02:07:16.385ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3812024-07-25T02:07:16.396ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:360
3822024-07-25T02:07:16.396ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 62718cfa-f65c-449a-866d-96573f2e371b (zpool)
3832024-07-25T02:07:16.511ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 62718cfa-f65c-449a-866d-96573f2e371b (zpool), kind: External }
3842024-07-25T02:07:16.519ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:348
3852024-07-25T02:07:16.519ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:350
3862024-07-25T02:07:16.519ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:354
3872024-07-25T02:07:16.520ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:356
3882024-07-25T02:07:16.520ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3892024-07-25T02:07:16.520ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3902024-07-25T02:07:16.520ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
3912024-07-25T02:07:16.561ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3922024-07-25T02:07:16.569ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_62718cfa-f65c-449a-866d-96573f2e371b/crypt/zone file = sled-storage/src/dataset.rs:411
3932024-07-25T02:07:16.717ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_62718cfa-f65c-449a-866d-96573f2e371b file = sled-storage/src/dataset.rs:496
3942024-07-25T02:07:16.725ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:512
3952024-07-25T02:07:16.725ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:429
3962024-07-25T02:07:16.725ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:414
3972024-07-25T02:07:16.725ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
3982024-07-25T02:07:16.725ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3992024-07-25T02:07:16.735ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:360
4002024-07-25T02:07:16.735ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 8bf94d57-ddf0-47ad-9696-adda8a5ae3ee (zpool)
4012024-07-25T02:07:16.847ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: 8bf94d57-ddf0-47ad-9696-adda8a5ae3ee (zpool), kind: External }
4022024-07-25T02:07:16.855ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:348
4032024-07-25T02:07:16.855ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:350
4042024-07-25T02:07:16.855ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:354
4052024-07-25T02:07:16.855ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:356
4062024-07-25T02:07:16.855ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4072024-07-25T02:07:16.855ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4082024-07-25T02:07:16.855ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
4092024-07-25T02:07:16.899ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4102024-07-25T02:07:16.907ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8bf94d57-ddf0-47ad-9696-adda8a5ae3ee/crypt/zone file = sled-storage/src/dataset.rs:411
4112024-07-25T02:07:16.927ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
4122024-07-25T02:07:17.051ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8bf94d57-ddf0-47ad-9696-adda8a5ae3ee file = sled-storage/src/dataset.rs:496
4132024-07-25T02:07:17.059ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:512
4142024-07-25T02:07:17.059ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:429
4152024-07-25T02:07:17.059ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:414
4162024-07-25T02:07:17.059ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:491
4172024-07-25T02:07:17.059ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4182024-07-25T02:07:17.070ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:360
4192024-07-25T02:07:17.070ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = d6b0bc68-da4e-43d7-b225-9edbd58635b0 (zpool)
4202024-07-25T02:07:17.186ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:304 zpool = ZpoolName { id: d6b0bc68-da4e-43d7-b225-9edbd58635b0 (zpool), kind: External }
4212024-07-25T02:07:17.193ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:348
4222024-07-25T02:07:17.193ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:350
4232024-07-25T02:07:17.193ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:354
4242024-07-25T02:07:17.193ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:356
4252024-07-25T02:07:17.193ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4262024-07-25T02:07:17.193ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4272024-07-25T02:07:17.193ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:368
4282024-07-25T02:07:17.234ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4292024-07-25T02:07:17.241ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d6b0bc68-da4e-43d7-b225-9edbd58635b0/crypt/zone file = sled-storage/src/dataset.rs:411
4302024-07-25T02:07:17.376ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d6b0bc68-da4e-43d7-b225-9edbd58635b0 file = sled-storage/src/dataset.rs:496
4312024-07-25T02:07:17.384ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:512
4322024-07-25T02:07:17.384ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:429
4332024-07-25T02:07:17.384ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4342024-07-25T02:07:17.385ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4d1a356e-07b8-4b75-8563-ff44a79058b8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 86b20be7-f0a0-4768-ad5c-f79c894a12e5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 62718cfa-f65c-449a-866d-96573f2e371b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8bf94d57-ddf0-47ad-9696-adda8a5ae3ee (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d6b0bc68-da4e-43d7-b225-9edbd58635b0 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4352024-07-25T02:07:17.385ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4362024-07-25T02:07:17.385ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4372024-07-25T02:07:17.385ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4382024-07-25T02:07:17.385ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:831 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
4392024-07-25T02:07:17.385ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4402024-07-25T02:07:17.385ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:857 generation = Generation(1) sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
4412024-07-25T02:07:17.385ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:862 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
4422024-07-25T02:07:17.385ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:867 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
4432024-07-25T02:07:17.385ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:116 gen = Generation(1) sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
4442024-07-25T02:07:17.385ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:873 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
4452024-07-25T02:07:17.385ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:822 gen = Generation(1)
4462024-07-25T02:07:17.385ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:878 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
4472024-07-25T02:07:17.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 12821449 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34314 req_id = cc1e1877-2194-431e-9edd-3c4d8c36832a response_code = 200 uri = /omicron-physical-disks
4482024-07-25T02:07:17.416ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 72c5db4f-848f-4294-962d-fc288ac2baaa, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
4492024-07-25T02:07:17.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48760
4502024-07-25T02:07:17.417ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
4512024-07-25T02:07:17.417ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4522024-07-25T02:07:17.477ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
4532024-07-25T02:07:17.477ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4542024-07-25T02:07:17.538ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
4552024-07-25T02:07:17.538ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }
4562024-07-25T02:07:17.599ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4572024-07-25T02:07:17.599ZINFOSledAgent (ServiceManager): No ledger in /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-zones.json file = common/src/ledger.rs:188
4582024-07-25T02:07:17.599ZINFOSledAgent (ServiceManager): No ledger in /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-zones.json file = common/src/ledger.rs:188
4592024-07-25T02:07:17.600ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4602024-07-25T02:07:17.644ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4612024-07-25T02:07:17.644ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4622024-07-25T02:07:17.644ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
4632024-07-25T02:07:17.696ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2 file = illumos-utils/src/zone.rs:316
4642024-07-25T02:07:17.700ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa file = illumos-utils/src/zone.rs:316
4652024-07-25T02:07:17.704ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937 file = illumos-utils/src/zone.rs:316
4662024-07-25T02:07:17.716ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2 file = illumos-utils/src/zone.rs:354
4672024-07-25T02:07:17.720ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa file = illumos-utils/src/zone.rs:354
4682024-07-25T02:07:17.724ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937 file = illumos-utils/src/zone.rs:354
4692024-07-25T02:07:17.929ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:225 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
4702024-07-25T02:07:17.967ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/95f9e969-8f6f-4c75-9a0a-2e70695a1940): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:600 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
4712024-07-25T02:07:19.208ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4722024-07-25T02:07:19.208ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4732024-07-25T02:07:19.209ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa
4742024-07-25T02:07:19.691ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4752024-07-25T02:07:19.691ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4762024-07-25T02:07:20.170ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4772024-07-25T02:07:20.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa") failed: Property not found. retry in 40.438066ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa
4782024-07-25T02:07:20.178ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937
4792024-07-25T02:07:20.182ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4802024-07-25T02:07:20.182ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2
4812024-07-25T02:07:20.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa") failed: Property not found. retry in 65.03388ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa
4822024-07-25T02:07:20.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937") failed: Property not found. retry in 25.627176ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937
4832024-07-25T02:07:20.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa") failed: Property not found. retry in 130.845422ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa
4842024-07-25T02:07:20.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2") failed: Property not found. retry in 52.24197ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2
4852024-07-25T02:07:20.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937") failed: Property not found. retry in 91.371252ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937
4862024-07-25T02:07:20.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2") failed: Property not found. retry in 54.075861ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2
4872024-07-25T02:07:20.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937") failed: Property not found. retry in 142.157238ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937
4882024-07-25T02:07:20.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2") failed: Property not found. retry in 189.151239ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2
4892024-07-25T02:07:20.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa") failed: Property not found. retry in 440.873608ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa
4902024-07-25T02:07:20.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937") failed: Property not found. retry in 490.442055ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937
4912024-07-25T02:07:20.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2") failed: Property not found. retry in 241.046176ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2
4922024-07-25T02:07:21.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2") failed: Property not found. retry in 517.428675ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2
4932024-07-25T02:07:21.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa") failed: Property not found. retry in 1.031887304s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa
4942024-07-25T02:07:21.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937") failed: Property not found. retry in 512.432384ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937
4952024-07-25T02:07:21.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2") failed: Property not found. retry in 1.449668891s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2
4962024-07-25T02:07:21.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937") failed: Property not found. retry in 994.090593ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937
4972024-07-25T02:07:22.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa") failed: Property not found. retry in 709.967732ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa
4982024-07-25T02:07:22.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937") failed: Property not found. retry in 962.11107ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937
4992024-07-25T02:07:22.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa") failed: Property not found. retry in 1.108460437s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa
5002024-07-25T02:07:23.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2") failed: Property not found. retry in 1.249669283s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2
5012024-07-25T02:07:23.199ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3947
5022024-07-25T02:07:23.199ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:3957 gateway = fd00:1122:3344:101::1
5032024-07-25T02:07:23.205ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4036
5042024-07-25T02:07:23.331ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4084
5052024-07-25T02:07:23.331ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4111
5062024-07-25T02:07:23.371ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4124
5072024-07-25T02:07:23.371ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:3988
5082024-07-25T02:07:23.424ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4030
5092024-07-25T02:07:23.424ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4091 rack_subnet = fd00:1122:3344::
5102024-07-25T02:07:23.444ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4102
5112024-07-25T02:07:23.444ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4144
5122024-07-25T02:07:23.532ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4176
5132024-07-25T02:07:23.532ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4182
5142024-07-25T02:07:23.639ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4223
5152024-07-25T02:07:23.639ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:364
5162024-07-25T02:07:23.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937") failed: Property not found. retry in 1.257103907s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937
5172024-07-25T02:07:23.675ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 40.515597ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:383
5182024-07-25T02:07:23.716ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 57.358501ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:383
5192024-07-25T02:07:23.776ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:412
5202024-07-25T02:07:23.808ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:651
5212024-07-25T02:07:23.809ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:689
5222024-07-25T02:07:23.810ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:692 uptime = 0
5232024-07-25T02:07:23.810ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:434
5242024-07-25T02:07:23.845ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
5252024-07-25T02:07:23.867ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
5262024-07-25T02:07:23.886ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:405
5272024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5282024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5292024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5302024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5312024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5322024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5332024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5342024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5352024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5362024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5372024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5382024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5392024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5402024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5412024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5422024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5432024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5442024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5452024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5462024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5472024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:601 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5482024-07-25T02:07:23.886ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:622 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5492024-07-25T02:07:23.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa") failed: Property not found. retry in 1.019469834s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa
5502024-07-25T02:07:24.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2") failed: Property not found. retry in 912.181686ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2
5512024-07-25T02:07:24.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937") failed: Property not found. retry in 749.190354ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937
5522024-07-25T02:07:25.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa") failed: Property not found. retry in 813.119978ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa
5532024-07-25T02:07:25.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2") failed: Property not found. retry in 1.011001129s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2
5542024-07-25T02:07:26.218ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_internal_dns_6169b0b2-1e10-45c5-94eb-83d56887cde2
5552024-07-25T02:07:26.218ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_internal_dns_72c5db4f-848f-4294-962d-fc288ac2baaa
5562024-07-25T02:07:26.218ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_internal_dns_87615c2b-3185-45ae-8ca8-cdcc5d2d9937
5572024-07-25T02:07:26.218ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5582024-07-25T02:07:26.219ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5592024-07-25T02:07:26.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 8802253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48760 req_id = fcf1b07f-afe2-43b5-a426-1ff718bf3a6b response_code = 204 uri = /omicron-zones
5602024-07-25T02:07:26.221ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5612024-07-25T02:07:26.249ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 77.010592ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:575
5622024-07-25T02:07:26.352ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5632024-07-25T02:07:26.411ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5642024-07-25T02:07:26.464ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:591
5652024-07-25T02:07:26.464ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
5662024-07-25T02:07:26.494ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
5672024-07-25T02:07:26.495ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
5682024-07-25T02:07:26.495ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
5692024-07-25T02:07:26.524ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 72c5db4f-848f-4294-962d-fc288ac2baaa, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 59769ee8-aeb9-416d-82c6-76f7839e075b, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f1961c75-7786-4cf2-ae17-ae1c8bf62c1e, kind: Service { id: 59769ee8-aeb9-416d-82c6-76f7839e075b }, name: Name("ntp-59769ee8-aeb9-416d-82c6-76f7839e075b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 223])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
5702024-07-25T02:07:26.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36638
5712024-07-25T02:07:26.525ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
5722024-07-25T02:07:26.525ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5732024-07-25T02:07:26.546ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
5742024-07-25T02:07:26.546ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5752024-07-25T02:07:26.564ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
5762024-07-25T02:07:26.564ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }
5772024-07-25T02:07:26.583ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
5782024-07-25T02:07:26.583ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-zones.json file = common/src/ledger.rs:177
5792024-07-25T02:07:26.583ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-zones.json file = common/src/ledger.rs:177
5802024-07-25T02:07:26.583ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
5812024-07-25T02:07:26.594ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
5822024-07-25T02:07:26.627ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
5832024-07-25T02:07:26.627ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
5842024-07-25T02:07:26.627ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
5852024-07-25T02:07:26.656ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 191, 223]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5862024-07-25T02:07:26.656ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1207 zone_type = boundary_ntp
5872024-07-25T02:07:26.657ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
5882024-07-25T02:07:26.657ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
5892024-07-25T02:07:26.657ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
5902024-07-25T02:07:26.657ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
5912024-07-25T02:07:26.680ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b file = illumos-utils/src/zone.rs:316
5922024-07-25T02:07:26.700ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b file = illumos-utils/src/zone.rs:354
5932024-07-25T02:07:27.331ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5942024-07-25T02:07:27.331ZINFOSledAgent (ServiceManager): Booting oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
5952024-07-25T02:07:27.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b") failed: Property not found. retry in 31.420229ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
5962024-07-25T02:07:27.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b") failed: Property not found. retry in 54.94067ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
5972024-07-25T02:07:27.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b") failed: Property not found. retry in 294.791945ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
5982024-07-25T02:07:27.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b") failed: Property not found. retry in 205.468146ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
5992024-07-25T02:07:28.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b") failed: Property not found. retry in 521.039068ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
6002024-07-25T02:07:28.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b") failed: Property not found. retry in 574.563636ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
6012024-07-25T02:07:29.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b") failed: Property not found. retry in 681.778974ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
6022024-07-25T02:07:29.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b") failed: Property not found. retry in 1.329277028s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
6032024-07-25T02:07:31.138ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.991192084s error = "no record found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = oximeter/producer/src/lib.rs:391 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
6042024-07-25T02:07:31.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b") failed: Property not found. retry in 1.118642203s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
6052024-07-25T02:07:32.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b") failed: Property not found. retry in 1.185154236s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
6062024-07-25T02:07:33.578ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b
6072024-07-25T02:07:33.579ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6082024-07-25T02:07:33.579ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6092024-07-25T02:07:33.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 7054668 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36638 req_id = bb70efef-2d95-4cba-b5fd-3d00e5e88277 response_code = 204 uri = /omicron-zones
6102024-07-25T02:07:33.581ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:632
6112024-07-25T02:07:33.610ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6122024-07-25T02:07:33.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55879
6132024-07-25T02:07:33.619ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3651
6142024-07-25T02:07:33.619ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:902 latency_us = 8801 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55879 req_id = 094cec73-0ca4-4185-8049-292d5927647d response_code = 500 uri = /timesync
6152024-07-25T02:07:33.621ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6162024-07-25T02:07:33.769ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6172024-07-25T02:07:33.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52770
6182024-07-25T02:07:37.779ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3651
6192024-07-25T02:07:37.779ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:902 latency_us = 4009086 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52770 req_id = 73f79b6d-7867-4ba5-b81a-2fc57b883258 response_code = 500 uri = /timesync
6202024-07-25T02:07:37.782ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6212024-07-25T02:07:37.941ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6222024-07-25T02:07:37.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48382
6232024-07-25T02:07:37.950ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3651
6242024-07-25T02:07:37.950ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:902 latency_us = 8578 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48382 req_id = 186b0c35-e9e5-4bf1-a700-7c0eb8f6c4eb response_code = 500 uri = /timesync
6252024-07-25T02:07:37.951ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6262024-07-25T02:07:38.173ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6272024-07-25T02:07:38.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38467
6282024-07-25T02:07:38.181ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_59769ee8-aeb9-416d-82c6-76f7839e075b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3651
6292024-07-25T02:07:38.181ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:902 latency_us = 8180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38467 req_id = 1aa3cee4-1510-476a-b841-5936aab35768 response_code = 500 uri = /timesync
6302024-07-25T02:07:38.184ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6312024-07-25T02:07:38.406ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6322024-07-25T02:07:38.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61823
6332024-07-25T02:07:38.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 8772 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61823 req_id = 3c4a4cea-60dd-4dcf-a0c1-9b222b64b714 response_code = 200 uri = /timesync
6342024-07-25T02:07:38.417ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6352024-07-25T02:07:38.417ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6362024-07-25T02:07:38.570ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6372024-07-25T02:07:38.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51614
6382024-07-25T02:07:38.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 9005 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51614 req_id = 09d67066-a4c1-4b7b-9085-d99fee9ef9d3 response_code = 200 uri = /timesync
6392024-07-25T02:07:38.582ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6402024-07-25T02:07:38.582ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6412024-07-25T02:07:38.836ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6422024-07-25T02:07:38.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59961
6432024-07-25T02:07:38.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 8856 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59961 req_id = c8e30488-05e9-4437-b16e-387869031b06 response_code = 200 uri = /timesync
6442024-07-25T02:07:38.848ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6452024-07-25T02:07:38.848ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6462024-07-25T02:07:39.116ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6472024-07-25T02:07:39.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38511
6482024-07-25T02:07:39.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 7590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38511 req_id = 817acee4-e13a-4591-b427-612d8267baca response_code = 200 uri = /timesync
6492024-07-25T02:07:39.125ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6502024-07-25T02:07:39.125ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6512024-07-25T02:07:39.444ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6522024-07-25T02:07:39.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39651
6532024-07-25T02:07:39.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 7439 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39651 req_id = 3042d40b-0122-4316-8246-3d24b00cb459 response_code = 200 uri = /timesync
6542024-07-25T02:07:39.455ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6552024-07-25T02:07:39.455ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6562024-07-25T02:07:39.805ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6572024-07-25T02:07:39.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47301
6582024-07-25T02:07:39.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 7051 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47301 req_id = 2a9cd936-03a2-4f81-95af-e21eda70e544 response_code = 200 uri = /timesync
6592024-07-25T02:07:39.815ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6602024-07-25T02:07:39.815ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6612024-07-25T02:07:40.750ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6622024-07-25T02:07:40.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54178
6632024-07-25T02:07:40.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 19102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54178 req_id = e5cf9e79-5673-4b83-aaf9-3c62fd4235de response_code = 200 uri = /timesync
6642024-07-25T02:07:40.773ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2395651603, ip_addr: 142.202.190.19, stratum: 3, ref_time: 1721873260.4684513, correction: 0.018621475 } file = sled-agent/src/rack_setup/service.rs:640
6652024-07-25T02:07:40.773ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1230
6662024-07-25T02:07:40.801ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 72c5db4f-848f-4294-962d-fc288ac2baaa, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 59769ee8-aeb9-416d-82c6-76f7839e075b, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f1961c75-7786-4cf2-ae17-ae1c8bf62c1e, kind: Service { id: 59769ee8-aeb9-416d-82c6-76f7839e075b }, name: Name("ntp-59769ee8-aeb9-416d-82c6-76f7839e075b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 223])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1dd1cb38-66f1-4365-881d-5f7e550be959, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } } } }, OmicronZoneConfig { id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } } } }, OmicronZoneConfig { id: 78c036ab-61da-4810-88d0-a8106af3d7fa, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
6672024-07-25T02:07:40.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48289
6682024-07-25T02:07:40.802ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
6692024-07-25T02:07:40.802ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6702024-07-25T02:07:40.821ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
6712024-07-25T02:07:40.821ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6722024-07-25T02:07:40.837ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
6732024-07-25T02:07:40.837ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }
6742024-07-25T02:07:40.856ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6752024-07-25T02:07:40.856ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6762024-07-25T02:07:40.920ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6772024-07-25T02:07:40.920ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6782024-07-25T02:07:40.987ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6792024-07-25T02:07:40.987ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6802024-07-25T02:07:41.046ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6812024-07-25T02:07:41.046ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6822024-07-25T02:07:41.106ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
6832024-07-25T02:07:41.106ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6842024-07-25T02:07:41.169ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
6852024-07-25T02:07:41.169ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-zones.json file = common/src/ledger.rs:177
6862024-07-25T02:07:41.169ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-zones.json file = common/src/ledger.rs:177
6872024-07-25T02:07:41.169ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
6882024-07-25T02:07:41.201ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
6892024-07-25T02:07:41.201ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
6902024-07-25T02:07:41.201ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
6912024-07-25T02:07:41.201ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
6922024-07-25T02:07:41.201ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
6932024-07-25T02:07:41.202ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a", TimeNotSynchronized), ("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959", TimeNotSynchronized), ("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6", TimeNotSynchronized), ("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa", TimeNotSynchronized), ("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07", TimeNotSynchronized)] file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:902 latency_us = 399443 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48289 req_id = d410b7d9-b4a9-4b3f-bfc4-89e81ef52cfa response_code = 500 uri = /omicron-zones
6942024-07-25T02:07:41.202ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d410b7d9-b4a9-4b3f-bfc4-89e81ef52cfa", "content-length": "124", "date": "Thu, 25 Jul 2024 02:07:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d410b7d9-b4a9-4b3f-bfc4-89e81ef52cfa" } file = sled-agent/src/rack_setup/service.rs:475 retry_after = 101.601638ms sled_address = [fd00:1122:3344:101::1]:12345
6952024-07-25T02:07:41.305ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 72c5db4f-848f-4294-962d-fc288ac2baaa, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 59769ee8-aeb9-416d-82c6-76f7839e075b, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f1961c75-7786-4cf2-ae17-ae1c8bf62c1e, kind: Service { id: 59769ee8-aeb9-416d-82c6-76f7839e075b }, name: Name("ntp-59769ee8-aeb9-416d-82c6-76f7839e075b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 223])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1dd1cb38-66f1-4365-881d-5f7e550be959, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } } } }, OmicronZoneConfig { id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } } } }, OmicronZoneConfig { id: 78c036ab-61da-4810-88d0-a8106af3d7fa, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
6962024-07-25T02:07:41.306ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
6972024-07-25T02:07:41.306ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6982024-07-25T02:07:41.325ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
6992024-07-25T02:07:41.325ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7002024-07-25T02:07:41.342ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7012024-07-25T02:07:41.342ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }
7022024-07-25T02:07:41.360ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7032024-07-25T02:07:41.360ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7042024-07-25T02:07:41.378ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7052024-07-25T02:07:41.378ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7062024-07-25T02:07:41.396ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7072024-07-25T02:07:41.396ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7082024-07-25T02:07:41.415ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7092024-07-25T02:07:41.415ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7102024-07-25T02:07:41.434ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7112024-07-25T02:07:41.434ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7122024-07-25T02:07:41.452ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7132024-07-25T02:07:41.452ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-zones.json file = common/src/ledger.rs:177
7142024-07-25T02:07:41.453ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-zones.json file = common/src/ledger.rs:177
7152024-07-25T02:07:41.453ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7162024-07-25T02:07:41.484ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
7172024-07-25T02:07:41.484ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
7182024-07-25T02:07:41.484ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
7192024-07-25T02:07:41.484ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
7202024-07-25T02:07:41.484ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
7212024-07-25T02:07:41.484ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07", TimeNotSynchronized), ("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959", TimeNotSynchronized), ("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa", TimeNotSynchronized), ("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6", TimeNotSynchronized), ("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a", TimeNotSynchronized)] file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:902 latency_us = 178006 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48289 req_id = 09192080-f976-48b8-8f3d-a2f7f8886f9e response_code = 500 uri = /omicron-zones
7222024-07-25T02:07:41.484ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "09192080-f976-48b8-8f3d-a2f7f8886f9e", "content-length": "124", "date": "Thu, 25 Jul 2024 02:07:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "09192080-f976-48b8-8f3d-a2f7f8886f9e" } file = sled-agent/src/rack_setup/service.rs:475 retry_after = 175.815738ms sled_address = [fd00:1122:3344:101::1]:12345
7232024-07-25T02:07:41.662ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 72c5db4f-848f-4294-962d-fc288ac2baaa, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 59769ee8-aeb9-416d-82c6-76f7839e075b, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f1961c75-7786-4cf2-ae17-ae1c8bf62c1e, kind: Service { id: 59769ee8-aeb9-416d-82c6-76f7839e075b }, name: Name("ntp-59769ee8-aeb9-416d-82c6-76f7839e075b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 223])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1dd1cb38-66f1-4365-881d-5f7e550be959, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } } } }, OmicronZoneConfig { id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } } } }, OmicronZoneConfig { id: 78c036ab-61da-4810-88d0-a8106af3d7fa, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
7242024-07-25T02:07:41.662ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7252024-07-25T02:07:41.662ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7262024-07-25T02:07:41.681ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7272024-07-25T02:07:41.681ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7282024-07-25T02:07:41.696ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7292024-07-25T02:07:41.696ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }
7302024-07-25T02:07:41.715ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7312024-07-25T02:07:41.715ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7322024-07-25T02:07:41.734ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7332024-07-25T02:07:41.734ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7342024-07-25T02:07:41.752ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7352024-07-25T02:07:41.752ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7362024-07-25T02:07:41.771ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7372024-07-25T02:07:41.771ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7382024-07-25T02:07:41.788ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7392024-07-25T02:07:41.788ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7402024-07-25T02:07:41.807ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7412024-07-25T02:07:41.807ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-zones.json file = common/src/ledger.rs:177
7422024-07-25T02:07:41.808ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-zones.json file = common/src/ledger.rs:177
7432024-07-25T02:07:41.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7442024-07-25T02:07:41.840ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
7452024-07-25T02:07:41.840ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
7462024-07-25T02:07:41.840ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
7472024-07-25T02:07:41.840ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
7482024-07-25T02:07:41.840ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
7492024-07-25T02:07:41.840ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a", TimeNotSynchronized), ("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa", TimeNotSynchronized), ("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07", TimeNotSynchronized), ("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959", TimeNotSynchronized), ("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6", TimeNotSynchronized)] file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:902 latency_us = 177693 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48289 req_id = 8a7c5ee0-2b9f-4b9f-bcdd-2b8ac51558f3 response_code = 500 uri = /omicron-zones
7502024-07-25T02:07:41.840ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8a7c5ee0-2b9f-4b9f-bcdd-2b8ac51558f3", "content-length": "124", "date": "Thu, 25 Jul 2024 02:07:41 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8a7c5ee0-2b9f-4b9f-bcdd-2b8ac51558f3" } file = sled-agent/src/rack_setup/service.rs:475 retry_after = 141.487756ms sled_address = [fd00:1122:3344:101::1]:12345
7512024-07-25T02:07:41.983ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 72c5db4f-848f-4294-962d-fc288ac2baaa, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 59769ee8-aeb9-416d-82c6-76f7839e075b, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f1961c75-7786-4cf2-ae17-ae1c8bf62c1e, kind: Service { id: 59769ee8-aeb9-416d-82c6-76f7839e075b }, name: Name("ntp-59769ee8-aeb9-416d-82c6-76f7839e075b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 223])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1dd1cb38-66f1-4365-881d-5f7e550be959, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } } } }, OmicronZoneConfig { id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } } } }, OmicronZoneConfig { id: 78c036ab-61da-4810-88d0-a8106af3d7fa, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
7522024-07-25T02:07:41.984ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7532024-07-25T02:07:41.984ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7542024-07-25T02:07:42.002ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7552024-07-25T02:07:42.002ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7562024-07-25T02:07:42.020ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7572024-07-25T02:07:42.020ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }
7582024-07-25T02:07:42.038ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7592024-07-25T02:07:42.038ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7602024-07-25T02:07:42.055ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7612024-07-25T02:07:42.055ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7622024-07-25T02:07:42.073ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7632024-07-25T02:07:42.073ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7642024-07-25T02:07:42.090ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7652024-07-25T02:07:42.090ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7662024-07-25T02:07:42.109ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7672024-07-25T02:07:42.109ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7682024-07-25T02:07:42.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7692024-07-25T02:07:42.129ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-zones.json file = common/src/ledger.rs:177
7702024-07-25T02:07:42.129ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-zones.json file = common/src/ledger.rs:177
7712024-07-25T02:07:42.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7722024-07-25T02:07:42.159ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
7732024-07-25T02:07:42.159ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
7742024-07-25T02:07:42.159ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
7752024-07-25T02:07:42.159ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
7762024-07-25T02:07:42.159ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3066 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
7772024-07-25T02:07:42.159ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6", TimeNotSynchronized), ("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07", TimeNotSynchronized), ("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a", TimeNotSynchronized), ("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959", TimeNotSynchronized), ("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa", TimeNotSynchronized)] file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:902 latency_us = 175533 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48289 req_id = 64e075f3-a157-4ccc-b3bd-0e17627d11d7 response_code = 500 uri = /omicron-zones
7782024-07-25T02:07:42.160ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "64e075f3-a157-4ccc-b3bd-0e17627d11d7", "content-length": "124", "date": "Thu, 25 Jul 2024 02:07:42 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "64e075f3-a157-4ccc-b3bd-0e17627d11d7" } file = sled-agent/src/rack_setup/service.rs:475 retry_after = 178.891284ms sled_address = [fd00:1122:3344:101::1]:12345
7792024-07-25T02:07:42.339ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 72c5db4f-848f-4294-962d-fc288ac2baaa, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 59769ee8-aeb9-416d-82c6-76f7839e075b, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f1961c75-7786-4cf2-ae17-ae1c8bf62c1e, kind: Service { id: 59769ee8-aeb9-416d-82c6-76f7839e075b }, name: Name("ntp-59769ee8-aeb9-416d-82c6-76f7839e075b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 223])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1dd1cb38-66f1-4365-881d-5f7e550be959, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } } } }, OmicronZoneConfig { id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } } } }, OmicronZoneConfig { id: 78c036ab-61da-4810-88d0-a8106af3d7fa, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
7802024-07-25T02:07:42.341ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7812024-07-25T02:07:42.341ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822024-07-25T02:07:42.360ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7832024-07-25T02:07:42.360ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842024-07-25T02:07:42.378ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
7852024-07-25T02:07:42.378ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862024-07-25T02:07:42.395ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7872024-07-25T02:07:42.395ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7882024-07-25T02:07:42.413ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7892024-07-25T02:07:42.413ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7902024-07-25T02:07:42.430ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7912024-07-25T02:07:42.430ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7922024-07-25T02:07:42.447ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7932024-07-25T02:07:42.447ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7942024-07-25T02:07:42.466ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
7952024-07-25T02:07:42.466ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7962024-07-25T02:07:42.483ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
7972024-07-25T02:07:42.483ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-zones.json file = common/src/ledger.rs:177
7982024-07-25T02:07:42.483ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-zones.json file = common/src/ledger.rs:177
7992024-07-25T02:07:42.483ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8002024-07-25T02:07:42.564ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8012024-07-25T02:07:42.564ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8022024-07-25T02:07:42.564ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8032024-07-25T02:07:42.564ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8042024-07-25T02:07:42.564ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
8052024-07-25T02:07:42.650ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6 file = illumos-utils/src/zone.rs:316
8062024-07-25T02:07:42.654ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a file = illumos-utils/src/zone.rs:316
8072024-07-25T02:07:42.658ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959 file = illumos-utils/src/zone.rs:316
8082024-07-25T02:07:42.661ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa file = illumos-utils/src/zone.rs:316
8092024-07-25T02:07:42.666ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07 file = illumos-utils/src/zone.rs:316
8102024-07-25T02:07:42.671ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6 file = illumos-utils/src/zone.rs:354
8112024-07-25T02:07:42.676ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a file = illumos-utils/src/zone.rs:354
8122024-07-25T02:07:42.680ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959 file = illumos-utils/src/zone.rs:354
8132024-07-25T02:07:42.685ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa file = illumos-utils/src/zone.rs:354
8142024-07-25T02:07:42.689ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07 file = illumos-utils/src/zone.rs:354
8152024-07-25T02:07:45.636ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='97e3b000-fdd6-4c61-98c8-1fa22d5f766a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8162024-07-25T02:07:45.636ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8172024-07-25T02:07:45.642ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8182024-07-25T02:07:45.642ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8192024-07-25T02:07:45.707ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1dd1cb38-66f1-4365-881d-5f7e550be959'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8202024-07-25T02:07:45.707ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8212024-07-25T02:07:45.765ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a14e2334-3547-4a29-bbe8-26ac5cb99c07'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8222024-07-25T02:07:45.766ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
8232024-07-25T02:07:45.774ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='78c036ab-61da-4810-88d0-a8106af3d7fa'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8242024-07-25T02:07:45.774ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8252024-07-25T02:07:45.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6") failed: Property not found. retry in 30.933268ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8262024-07-25T02:07:45.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a") failed: Property not found. retry in 39.108383ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8272024-07-25T02:07:45.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6") failed: Property not found. retry in 146.236945ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8282024-07-25T02:07:45.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959") failed: Property not found. retry in 30.821336ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8292024-07-25T02:07:45.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a") failed: Property not found. retry in 54.394029ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8302024-07-25T02:07:46.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959") failed: Property not found. retry in 149.226202ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8312024-07-25T02:07:46.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6") failed: Property not found. retry in 134.024873ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8322024-07-25T02:07:46.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a") failed: Property not found. retry in 223.832323ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8332024-07-25T02:07:46.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07") failed: Property not found. retry in 47.700902ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
8342024-07-25T02:07:46.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6") failed: Property not found. retry in 385.742358ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8352024-07-25T02:07:46.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a") failed: Property not found. retry in 362.519467ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8362024-07-25T02:07:46.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959") failed: Property not found. retry in 286.412192ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8372024-07-25T02:07:46.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 68.297683ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8382024-07-25T02:07:46.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07") failed: Property not found. retry in 71.054346ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
8392024-07-25T02:07:46.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 50.512313ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8402024-07-25T02:07:47.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6") failed: Property not found. retry in 1.193534511s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8412024-07-25T02:07:47.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a") failed: Property not found. retry in 706.352864ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8422024-07-25T02:07:47.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959") failed: Property not found. retry in 368.033528ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8432024-07-25T02:07:47.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 253.622239ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8442024-07-25T02:07:47.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07") failed: Property not found. retry in 240.376573ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
8452024-07-25T02:07:47.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 579.511484ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8462024-07-25T02:07:47.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959") failed: Property not found. retry in 468.952122ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8472024-07-25T02:07:47.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07") failed: Property not found. retry in 211.624177ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
8482024-07-25T02:07:47.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07") failed: Property not found. retry in 852.532289ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
8492024-07-25T02:07:47.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a") failed: Property not found. retry in 612.45892ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8502024-07-25T02:07:48.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959") failed: Property not found. retry in 1.187464564s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8512024-07-25T02:07:48.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6") failed: Property not found. retry in 716.507855ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8522024-07-25T02:07:48.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 553.405923ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8532024-07-25T02:07:48.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a") failed: Property not found. retry in 998.750471ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8542024-07-25T02:07:48.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07") failed: Property not found. retry in 1.233449043s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
8552024-07-25T02:07:48.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 1.102695838s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8562024-07-25T02:07:48.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6") failed: Property not found. retry in 1.091896542s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8572024-07-25T02:07:49.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959") failed: Property not found. retry in 505.15525ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8582024-07-25T02:07:49.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a") failed: Property not found. retry in 1.435096724s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8592024-07-25T02:07:49.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07") failed: Property not found. retry in 710.670777ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
8602024-07-25T02:07:49.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 1.357532207s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8612024-07-25T02:07:49.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959") failed: Property not found. retry in 1.153833743s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8622024-07-25T02:07:50.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6") failed: Property not found. retry in 884.961095ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8632024-07-25T02:07:50.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07") failed: Property not found. retry in 607.880521ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
8642024-07-25T02:07:50.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a") failed: Property not found. retry in 1.01166026s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8652024-07-25T02:07:50.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6") failed: Property not found. retry in 1.034830055s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8662024-07-25T02:07:51.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959") failed: Property not found. retry in 961.456779ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8672024-07-25T02:07:51.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07") failed: Property not found. retry in 1.488015507s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
8682024-07-25T02:07:51.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 1.093217665s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8692024-07-25T02:07:51.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a") failed: Property not found. retry in 1.125778213s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8702024-07-25T02:07:52.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6") failed: Property not found. retry in 1.421848535s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8712024-07-25T02:07:52.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959") failed: Property not found. retry in 872.201086ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8722024-07-25T02:07:52.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 1.136257445s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8732024-07-25T02:07:52.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07") failed: Property not found. retry in 1.431795099s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
8742024-07-25T02:07:52.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959") failed: Property not found. retry in 1.485794344s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
8752024-07-25T02:07:53.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a") failed: Property not found. retry in 943.945611ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8762024-07-25T02:07:53.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6") failed: Property not found. retry in 1.468057592s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8772024-07-25T02:07:53.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 742.514935ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8782024-07-25T02:07:53.580ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55129
8792024-07-25T02:07:53.580ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 107 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55129 req_id = 8ed86c76-b315-4788-99de-962a3e14370b response_code = 200 uri = /baseboard
8802024-07-25T02:07:54.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 549.903932ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8812024-07-25T02:07:54.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 1.381823417s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8822024-07-25T02:07:56.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 916.087376ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8832024-07-25T02:07:57.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 1.299498864s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8842024-07-25T02:07:58.373ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 194.777517ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
8852024-07-25T02:07:58.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 835.096407ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8862024-07-25T02:07:59.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 703.431777ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8872024-07-25T02:08:00.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 502.851173ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8882024-07-25T02:08:00.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 1.246704383s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8892024-07-25T02:08:01.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 950.559416ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8902024-07-25T02:08:02.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 1.019912867s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8912024-07-25T02:08:03.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 917.113921ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8922024-07-25T02:08:04.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 633.942498ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8932024-07-25T02:08:05.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 1.322445749s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8942024-07-25T02:08:06.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 620.576697ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8952024-07-25T02:08:07.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 836.42146ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8962024-07-25T02:08:08.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa") failed: Property not found. retry in 692.354328ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
8972024-07-25T02:08:09.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_cockroachdb_4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6
8982024-07-25T02:08:09.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_cockroachdb_97e3b000-fdd6-4c61-98c8-1fa22d5f766a
8992024-07-25T02:08:09.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_cockroachdb_1dd1cb38-66f1-4365-881d-5f7e550be959
9002024-07-25T02:08:09.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_cockroachdb_78c036ab-61da-4810-88d0-a8106af3d7fa
9012024-07-25T02:08:09.110ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_cockroachdb_a14e2334-3547-4a29-bbe8-26ac5cb99c07
9022024-07-25T02:08:09.110ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9032024-07-25T02:08:09.110ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9042024-07-25T02:08:09.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 26767976 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48289 req_id = 65a81d69-4b62-4224-aad7-a6caa33f4582 response_code = 204 uri = /omicron-zones
9052024-07-25T02:08:09.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47898
9062024-07-25T02:08:09.188ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3485
9072024-07-25T02:08:10.480ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3503
9082024-07-25T02:08:13.612ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 275.676242ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
9092024-07-25T02:08:16.852ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3526
9102024-07-25T02:08:16.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 7690651 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47898 req_id = 132de340-a135-41b3-be4b-14ec1ab2ad8b response_code = 204 uri = /cockroachdb
9112024-07-25T02:08:16.884ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 72c5db4f-848f-4294-962d-fc288ac2baaa, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 59769ee8-aeb9-416d-82c6-76f7839e075b, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f1961c75-7786-4cf2-ae17-ae1c8bf62c1e, kind: Service { id: 59769ee8-aeb9-416d-82c6-76f7839e075b }, name: Name("ntp-59769ee8-aeb9-416d-82c6-76f7839e075b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 223])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1dd1cb38-66f1-4365-881d-5f7e550be959, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } } } }, OmicronZoneConfig { id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } } } }, OmicronZoneConfig { id: 78c036ab-61da-4810-88d0-a8106af3d7fa, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External } } } }, OmicronZoneConfig { id: f4b3f798-a13c-49e1-99a7-fd75c3def461, underlay_address: fd00:1122:3344:101::8, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 6d6d1a80-5286-4c9f-95df-8068ad02f390, kind: Service { id: f4b3f798-a13c-49e1-99a7-fd75c3def461 }, name: Name("external-dns-f4b3f798-a13c-49e1-99a7-fd75c3def461"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 95])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 9f058198-eda8-4c0e-b8ea-30eb0b528159, underlay_address: fd00:1122:3344:101::9, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 2660255a-6e82-49c7-ae2e-1d3c92d8bd9d, kind: Service { id: 9f058198-eda8-4c0e-b8ea-30eb0b528159 }, name: Name("external-dns-9f058198-eda8-4c0e-b8ea-30eb0b528159"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: e2911521-a3ee-44ca-b0d0-d76b758cadb2, underlay_address: fd00:1122:3344:101::a, filesystem_pool: Some(ZpoolName { id: 62718cfa-f65c-449a-866d-96573f2e371b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 508f9e23-8d99-43a2-aeb6-2134550fe4a5, kind: Service { id: e2911521-a3ee-44ca-b0d0-d76b758cadb2 }, name: Name("nexus-e2911521-a3ee-44ca-b0d0-d76b758cadb2"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4cc78cbb-766f-4dce-b83d-e0ce8e85fc47, underlay_address: fd00:1122:3344:101::b, filesystem_pool: Some(ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 2c79351b-16e9-49a1-99bb-1ac9e3bb56dd, kind: Service { id: 4cc78cbb-766f-4dce-b83d-e0ce8e85fc47 }, name: Name("nexus-4cc78cbb-766f-4dce-b83d-e0ce8e85fc47"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 594bcd89-4b8f-4545-902d-96c524c9339d, underlay_address: fd00:1122:3344:101::c, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 3c7afaa5-efdb-419d-8129-1c41d624f824, kind: Service { id: 594bcd89-4b8f-4545-902d-96c524c9339d }, name: Name("nexus-594bcd89-4b8f-4545-902d-96c524c9339d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ffda95b3-f1f2-4ab1-abeb-93469c954af2, underlay_address: fd00:1122:3344:101::d, filesystem_pool: Some(ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93, underlay_address: fd00:1122:3344:101::e, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7f18ebb9-c046-4795-b463-fe098a9111eb, underlay_address: fd00:1122:3344:101::f, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: a991046c-7ae8-416c-ac68-e4e10ce104a0, underlay_address: fd00:1122:3344:101::10, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: afe4f4fc-0d66-4665-ba04-4246e5e90f2b, underlay_address: fd00:1122:3344:101::11, filesystem_pool: Some(ZpoolName { id: 62718cfa-f65c-449a-866d-96573f2e371b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: d275e9ef-209a-4386-8746-e2654671f435, underlay_address: fd00:1122:3344:101::12, filesystem_pool: Some(ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External } } } }, OmicronZoneConfig { id: d2da6631-7332-419f-87ad-4498ea3b0b27, underlay_address: fd00:1122:3344:101::13, filesystem_pool: Some(ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2d8d8175-d54b-4fc7-8234-c018bc6ce25b, underlay_address: fd00:1122:3344:101::14, filesystem_pool: Some(ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External } } } }, OmicronZoneConfig { id: dab49687-4a1d-454d-86fa-c5dbd1f53b48, underlay_address: fd00:1122:3344:101::15, filesystem_pool: Some(ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External } } } }, OmicronZoneConfig { id: a65f784e-83be-44ce-a73c-a4800feee020, underlay_address: fd00:1122:3344:101::16, filesystem_pool: Some(ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External } } } }, OmicronZoneConfig { id: 89bf7581-a9a9-4f0b-8cea-ab94c858c51f, underlay_address: fd00:1122:3344:101::17, filesystem_pool: Some(ZpoolName { id: 86b20be7-f0a0-4768-ad5c-f79c894a12e5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 86b20be7-f0a0-4768-ad5c-f79c894a12e5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 84ba098c-f858-42b0-a745-87982cf97f8e, underlay_address: fd00:1122:3344:101::18, filesystem_pool: Some(ZpoolName { id: 62718cfa-f65c-449a-866d-96573f2e371b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 62718cfa-f65c-449a-866d-96573f2e371b (zpool), kind: External } } } }, OmicronZoneConfig { id: 6fe3427d-861d-4413-a2f2-00f0ef53c243, underlay_address: fd00:1122:3344:101::19, filesystem_pool: Some(ZpoolName { id: 8bf94d57-ddf0-47ad-9696-adda8a5ae3ee (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8bf94d57-ddf0-47ad-9696-adda8a5ae3ee (zpool), kind: External } } } }, OmicronZoneConfig { id: 69b87776-767f-4899-8b21-1eaa71b3a9bb, underlay_address: fd00:1122:3344:101::1a, filesystem_pool: Some(ZpoolName { id: d6b0bc68-da4e-43d7-b225-9edbd58635b0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d6b0bc68-da4e-43d7-b225-9edbd58635b0 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
9122024-07-25T02:08:16.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55996
9132024-07-25T02:08:16.884ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
9142024-07-25T02:08:16.884ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 6169b0b2-1e10-45c5-94eb-83d56887cde2, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9152024-07-25T02:08:16.909ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
9162024-07-25T02:08:16.909ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 72c5db4f-848f-4294-962d-fc288ac2baaa, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9172024-07-25T02:08:16.929ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
9182024-07-25T02:08:16.929ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 87615c2b-3185-45ae-8ca8-cdcc5d2d9937, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: InternalDns }, responder: ... }
9192024-07-25T02:08:16.950ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
9202024-07-25T02:08:16.950ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 97e3b000-fdd6-4c61-98c8-1fa22d5f766a, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9212024-07-25T02:08:16.969ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
9222024-07-25T02:08:16.969ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 1dd1cb38-66f1-4365-881d-5f7e550be959, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9232024-07-25T02:08:16.989ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
9242024-07-25T02:08:16.989ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: a14e2334-3547-4a29-bbe8-26ac5cb99c07, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9252024-07-25T02:08:17.010ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
9262024-07-25T02:08:17.010ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 78c036ab-61da-4810-88d0-a8106af3d7fa, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9272024-07-25T02:08:17.032ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:405
9282024-07-25T02:08:17.032ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 4bb7f9d5-6280-4db8-88d4-f1d9eb8674b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9292024-07-25T02:08:17.053ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f4b3f798-a13c-49e1-99a7-fd75c3def461, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
9302024-07-25T02:08:17.053ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: f4b3f798-a13c-49e1-99a7-fd75c3def461, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9312024-07-25T02:08:17.136ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9f058198-eda8-4c0e-b8ea-30eb0b528159, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:405
9322024-07-25T02:08:17.136ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 9f058198-eda8-4c0e-b8ea-30eb0b528159, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9332024-07-25T02:08:17.227ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:405
9342024-07-25T02:08:17.227ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9352024-07-25T02:08:17.311ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d275e9ef-209a-4386-8746-e2654671f435, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9362024-07-25T02:08:17.311ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: d275e9ef-209a-4386-8746-e2654671f435, dataset_name: DatasetName { pool_name: ZpoolName { id: 553fca36-adc1-4511-ade0-15a4f26d9fb9 (zpool), kind: External }, kind: Crucible }, responder: ... }
9372024-07-25T02:08:17.388ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d2da6631-7332-419f-87ad-4498ea3b0b27, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9382024-07-25T02:08:17.388ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: d2da6631-7332-419f-87ad-4498ea3b0b27, dataset_name: DatasetName { pool_name: ZpoolName { id: e6466883-5708-491f-861b-b8c70eb06724 (zpool), kind: External }, kind: Crucible }, responder: ... }
9392024-07-25T02:08:17.462ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2d8d8175-d54b-4fc7-8234-c018bc6ce25b, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9402024-07-25T02:08:17.462ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 2d8d8175-d54b-4fc7-8234-c018bc6ce25b, dataset_name: DatasetName { pool_name: ZpoolName { id: ef02fb81-56c7-4030-b314-3b86902902ba (zpool), kind: External }, kind: Crucible }, responder: ... }
9412024-07-25T02:08:17.544ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: dab49687-4a1d-454d-86fa-c5dbd1f53b48, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9422024-07-25T02:08:17.544ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: dab49687-4a1d-454d-86fa-c5dbd1f53b48, dataset_name: DatasetName { pool_name: ZpoolName { id: 07a306b8-24ae-4dbc-9694-d9d608dbd480 (zpool), kind: External }, kind: Crucible }, responder: ... }
9432024-07-25T02:08:17.621ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a65f784e-83be-44ce-a73c-a4800feee020, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9442024-07-25T02:08:17.621ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: a65f784e-83be-44ce-a73c-a4800feee020, dataset_name: DatasetName { pool_name: ZpoolName { id: 38b79612-f102-46a4-a399-b1bc12efc31a (zpool), kind: External }, kind: Crucible }, responder: ... }
9452024-07-25T02:08:17.701ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 89bf7581-a9a9-4f0b-8cea-ab94c858c51f, dataset_name: DatasetName { pool_name: ZpoolName { id: 86b20be7-f0a0-4768-ad5c-f79c894a12e5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9462024-07-25T02:08:17.702ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 89bf7581-a9a9-4f0b-8cea-ab94c858c51f, dataset_name: DatasetName { pool_name: ZpoolName { id: 86b20be7-f0a0-4768-ad5c-f79c894a12e5 (zpool), kind: External }, kind: Crucible }, responder: ... }
9472024-07-25T02:08:17.767ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 84ba098c-f858-42b0-a745-87982cf97f8e, dataset_name: DatasetName { pool_name: ZpoolName { id: 62718cfa-f65c-449a-866d-96573f2e371b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9482024-07-25T02:08:17.767ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 84ba098c-f858-42b0-a745-87982cf97f8e, dataset_name: DatasetName { pool_name: ZpoolName { id: 62718cfa-f65c-449a-866d-96573f2e371b (zpool), kind: External }, kind: Crucible }, responder: ... }
9492024-07-25T02:08:17.831ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6fe3427d-861d-4413-a2f2-00f0ef53c243, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bf94d57-ddf0-47ad-9696-adda8a5ae3ee (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9502024-07-25T02:08:17.831ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 6fe3427d-861d-4413-a2f2-00f0ef53c243, dataset_name: DatasetName { pool_name: ZpoolName { id: 8bf94d57-ddf0-47ad-9696-adda8a5ae3ee (zpool), kind: External }, kind: Crucible }, responder: ... }
9512024-07-25T02:08:17.894ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69b87776-767f-4899-8b21-1eaa71b3a9bb, dataset_name: DatasetName { pool_name: ZpoolName { id: d6b0bc68-da4e-43d7-b225-9edbd58635b0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:405
9522024-07-25T02:08:17.894ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:772 request = NewFilesystemRequest { dataset_id: 69b87776-767f-4899-8b21-1eaa71b3a9bb, dataset_name: DatasetName { pool_name: ZpoolName { id: d6b0bc68-da4e-43d7-b225-9edbd58635b0 (zpool), kind: External }, kind: Crucible }, responder: ... }
9532024-07-25T02:08:17.959ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9542024-07-25T02:08:17.959ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-zones.json file = common/src/ledger.rs:177
9552024-07-25T02:08:17.959ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-zones.json file = common/src/ledger.rs:177
9562024-07-25T02:08:17.959ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9572024-07-25T02:08:18.072ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
9582024-07-25T02:08:18.085ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
9592024-07-25T02:08:18.134ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
9602024-07-25T02:08:18.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9612024-07-25T02:08:18.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9622024-07-25T02:08:18.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9632024-07-25T02:08:18.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9642024-07-25T02:08:18.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9652024-07-25T02:08:18.136ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
9662024-07-25T02:08:18.149ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9672024-07-25T02:08:18.149ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9682024-07-25T02:08:18.352ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:258
9692024-07-25T02:08:18.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9702024-07-25T02:08:18.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9712024-07-25T02:08:18.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9722024-07-25T02:08:18.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9732024-07-25T02:08:18.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9742024-07-25T02:08:18.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9752024-07-25T02:08:18.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
9762024-07-25T02:08:18.353ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb file = illumos-utils/src/zone.rs:316
9772024-07-25T02:08:18.359ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435 file = illumos-utils/src/zone.rs:316
9782024-07-25T02:08:18.363ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27 file = illumos-utils/src/zone.rs:316
9792024-07-25T02:08:18.367ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020 file = illumos-utils/src/zone.rs:316
9802024-07-25T02:08:18.372ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243 file = illumos-utils/src/zone.rs:316
9812024-07-25T02:08:18.378ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2 file = illumos-utils/src/zone.rs:316
9822024-07-25T02:08:18.383ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93 file = illumos-utils/src/zone.rs:316
9832024-07-25T02:08:18.521ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb file = illumos-utils/src/zone.rs:354
9842024-07-25T02:08:18.526ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435 file = illumos-utils/src/zone.rs:354
9852024-07-25T02:08:18.531ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27 file = illumos-utils/src/zone.rs:354
9862024-07-25T02:08:18.535ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020 file = illumos-utils/src/zone.rs:354
9872024-07-25T02:08:18.540ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243 file = illumos-utils/src/zone.rs:354
9882024-07-25T02:08:18.545ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2 file = illumos-utils/src/zone.rs:354
9892024-07-25T02:08:18.550ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93 file = illumos-utils/src/zone.rs:354
9902024-07-25T02:08:18.555ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0 file = illumos-utils/src/zone.rs:316
9912024-07-25T02:08:18.561ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b file = illumos-utils/src/zone.rs:316
9922024-07-25T02:08:18.566ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f file = illumos-utils/src/zone.rs:316
9932024-07-25T02:08:18.572ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48 file = illumos-utils/src/zone.rs:316
9942024-07-25T02:08:18.579ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e file = illumos-utils/src/zone.rs:316
9952024-07-25T02:08:18.585ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb file = illumos-utils/src/zone.rs:316
9962024-07-25T02:08:18.593ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b file = illumos-utils/src/zone.rs:316
9972024-07-25T02:08:18.600ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0 file = illumos-utils/src/zone.rs:354
9982024-07-25T02:08:18.605ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b file = illumos-utils/src/zone.rs:354
9992024-07-25T02:08:18.610ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f file = illumos-utils/src/zone.rs:354
10002024-07-25T02:08:18.616ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48 file = illumos-utils/src/zone.rs:354
10012024-07-25T02:08:18.622ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e file = illumos-utils/src/zone.rs:354
10022024-07-25T02:08:18.628ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb file = illumos-utils/src/zone.rs:354
10032024-07-25T02:08:18.634ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b file = illumos-utils/src/zone.rs:354
10042024-07-25T02:08:18.685ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
10052024-07-25T02:08:18.751ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
10062024-07-25T02:08:18.814ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
10072024-07-25T02:08:18.920ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
10082024-07-25T02:08:19.023ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:275
10092024-07-25T02:08:19.026ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
10102024-07-25T02:08:19.026ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
10112024-07-25T02:08:19.077ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 146, 118]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10122024-07-25T02:08:19.077ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1207 zone_type = external_dns
10132024-07-25T02:08:19.079ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
10142024-07-25T02:08:19.079ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
10152024-07-25T02:08:19.128ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 188, 95]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10162024-07-25T02:08:19.128ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1207 zone_type = external_dns
10172024-07-25T02:08:19.129ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
10182024-07-25T02:08:19.129ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
10192024-07-25T02:08:19.178ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 245, 21]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10202024-07-25T02:08:19.178ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1207 zone_type = nexus
10212024-07-25T02:08:19.180ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
10222024-07-25T02:08:19.180ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
10232024-07-25T02:08:19.229ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 171, 103]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10242024-07-25T02:08:19.229ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1207 zone_type = nexus
10252024-07-25T02:08:19.231ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:300
10262024-07-25T02:08:19.231ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:192
10272024-07-25T02:08:19.281ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 223, 75]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10282024-07-25T02:08:19.281ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1207 zone_type = nexus
10292024-07-25T02:08:19.282ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
10302024-07-25T02:08:19.282ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
10312024-07-25T02:08:19.282ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
10322024-07-25T02:08:19.282ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
10332024-07-25T02:08:19.283ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
10342024-07-25T02:08:19.283ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
10352024-07-25T02:08:19.283ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
10362024-07-25T02:08:19.283ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
10372024-07-25T02:08:19.283ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
10382024-07-25T02:08:19.283ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
10392024-07-25T02:08:19.285ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
10402024-07-25T02:08:19.286ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10412024-07-25T02:08:19.401ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
10422024-07-25T02:08:19.406ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
10432024-07-25T02:08:19.410ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
10442024-07-25T02:08:19.410ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10452024-07-25T02:08:19.410ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10462024-07-25T02:08:19.414ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
10472024-07-25T02:08:19.418ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10482024-07-25T02:08:19.418ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
10492024-07-25T02:08:21.177ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47 file = illumos-utils/src/zone.rs:316
10502024-07-25T02:08:21.186ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159 file = illumos-utils/src/zone.rs:316
10512024-07-25T02:08:21.197ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461 file = illumos-utils/src/zone.rs:316
10522024-07-25T02:08:21.254ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2 file = illumos-utils/src/zone.rs:316
10532024-07-25T02:08:21.323ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d file = illumos-utils/src/zone.rs:316
10542024-07-25T02:08:21.339ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47 file = illumos-utils/src/zone.rs:354
10552024-07-25T02:08:21.365ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159 file = illumos-utils/src/zone.rs:354
10562024-07-25T02:08:21.384ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461 file = illumos-utils/src/zone.rs:354
10572024-07-25T02:08:21.583ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2 file = illumos-utils/src/zone.rs:354
10582024-07-25T02:08:21.624ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d file = illumos-utils/src/zone.rs:354
10592024-07-25T02:08:25.811ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40770
10602024-07-25T02:08:25.812ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1104 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40770 req_id = fe8f56f4-d4b1-4173-af25-ff0d86c401fe response_code = 200 uri = /baseboard
10612024-07-25T02:08:25.993ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10622024-07-25T02:08:26.005ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
10632024-07-25T02:08:26.032ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10642024-07-25T02:08:26.049ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10652024-07-25T02:08:26.049ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
10662024-07-25T02:08:26.059ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
10672024-07-25T02:08:26.241ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e6466883-5708-491f-861b-b8c70eb06724/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='076b2267-1146-4959-84a6-9f36fb7dc8fe'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10682024-07-25T02:08:26.242ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
10692024-07-25T02:08:26.268ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_553fca36-adc1-4511-ade0-15a4f26d9fb9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='974b0d0e-b726-40b0-8fe1-59a6c6e18eb4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10702024-07-25T02:08:26.282ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_38b79612-f102-46a4-a399-b1bc12efc31a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b2fc2b0c-6b5d-4f87-a695-03fd644cf05c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10712024-07-25T02:08:26.282ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
10722024-07-25T02:08:26.291ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
10732024-07-25T02:08:26.303ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8bf94d57-ddf0-47ad-9696-adda8a5ae3ee/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dbda5ba4-efe7-400a-b266-936d62dbb095'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10742024-07-25T02:08:26.310ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d6b0bc68-da4e-43d7-b225-9edbd58635b0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5776d82b-2624-4845-9f4b-62f458fb49dc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10752024-07-25T02:08:26.311ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ef02fb81-56c7-4030-b314-3b86902902ba/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='457c7d11-8638-4713-9172-5963f1b6652c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10762024-07-25T02:08:26.311ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
10772024-07-25T02:08:26.320ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_07a306b8-24ae-4dbc-9694-d9d608dbd480/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e0237200-2f77-40a4-bb81-8d7f1d473420'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10782024-07-25T02:08:26.321ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_62718cfa-f65c-449a-866d-96573f2e371b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='64761147-3178-4676-9c2d-51481a490342'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10792024-07-25T02:08:26.321ZINFOSledAgent (ServiceManager): Booting oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
10802024-07-25T02:08:26.330ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
10812024-07-25T02:08:26.337ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_86b20be7-f0a0-4768-ad5c-f79c894a12e5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9aaf6ac4-88c3-4f83-9657-943374926927'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10822024-07-25T02:08:26.337ZINFOSledAgent (ServiceManager): Booting oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
10832024-07-25T02:08:26.344ZINFOSledAgent (ServiceManager): Booting oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
10842024-07-25T02:08:26.352ZINFOSledAgent (ServiceManager): Booting oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
10852024-07-25T02:08:26.421ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='ffda95b3-f1f2-4ab1-abeb-93469c954af2'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10862024-07-25T02:08:26.422ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
10872024-07-25T02:08:26.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 34.82614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
10882024-07-25T02:08:26.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 30.780966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
10892024-07-25T02:08:27.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 56.917526ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
10902024-07-25T02:08:27.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 56.209007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
10912024-07-25T02:08:27.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 63.078706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
10922024-07-25T02:08:27.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 26.981101ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
10932024-07-25T02:08:27.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 60.750375ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
10942024-07-25T02:08:27.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 25.940181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
10952024-07-25T02:08:27.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 42.509903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
10962024-07-25T02:08:28.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 89.264703ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
10972024-07-25T02:08:28.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 67.627863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
10982024-07-25T02:08:28.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 99.60355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
10992024-07-25T02:08:28.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 68.261568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
11002024-07-25T02:08:28.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 128.329077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
11012024-07-25T02:08:28.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 59.108472ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
11022024-07-25T02:08:28.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 86.349442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
11032024-07-25T02:08:28.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 143.289794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
11042024-07-25T02:08:28.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 134.380414ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
11052024-07-25T02:08:28.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 48.493952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
11062024-07-25T02:08:28.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 136.889789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
11072024-07-25T02:08:29.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 134.441101ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
11082024-07-25T02:08:29.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 47.758295ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
11092024-07-25T02:08:29.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 254.360028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
11102024-07-25T02:08:29.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 54.403523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
11112024-07-25T02:08:29.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 119.350386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
11122024-07-25T02:08:29.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 128.699313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
11132024-07-25T02:08:29.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 172.842345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
11142024-07-25T02:08:29.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 82.852033ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
11152024-07-25T02:08:29.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 137.900278ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
11162024-07-25T02:08:30.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 148.991929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
11172024-07-25T02:08:30.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 112.744445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
11182024-07-25T02:08:30.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 63.417644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
11192024-07-25T02:08:30.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 141.528901ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
11202024-07-25T02:08:30.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 216.663438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
11212024-07-25T02:08:30.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 58.629638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
11222024-07-25T02:08:30.938ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11232024-07-25T02:08:30.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 405.447404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
11242024-07-25T02:08:31.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 215.238936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
11252024-07-25T02:08:31.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 391.487292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
11262024-07-25T02:08:31.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 529.552953ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
11272024-07-25T02:08:31.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 369.246156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
11282024-07-25T02:08:31.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 128.90605ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
11292024-07-25T02:08:31.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 541.377552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
11302024-07-25T02:08:31.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 391.49711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
11312024-07-25T02:08:31.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 233.714712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
11322024-07-25T02:08:31.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 185.700969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
11332024-07-25T02:08:31.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 364.30962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
11342024-07-25T02:08:31.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 374.599681ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
11352024-07-25T02:08:32.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 156.10378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
11362024-07-25T02:08:32.225ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
11372024-07-25T02:08:32.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 875.097343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
11382024-07-25T02:08:32.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 443.149417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
11392024-07-25T02:08:32.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 619.364832ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
11402024-07-25T02:08:32.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 673.39983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
11412024-07-25T02:08:32.665ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.035127588s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
11422024-07-25T02:08:32.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 917.333873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
11432024-07-25T02:08:32.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 266.695983ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
11442024-07-25T02:08:32.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 447.473688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
11452024-07-25T02:08:32.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 685.866909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
11462024-07-25T02:08:32.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 1.070961189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
11472024-07-25T02:08:32.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 558.501896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
11482024-07-25T02:08:32.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 903.642883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
11492024-07-25T02:08:32.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 939.384308ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
11502024-07-25T02:08:32.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 491.729774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
11512024-07-25T02:08:32.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 477.997044ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
11522024-07-25T02:08:32.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.072032694s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
11532024-07-25T02:08:33.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 61.757352ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
11542024-07-25T02:08:33.101ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11552024-07-25T02:08:33.102ZINFOSledAgent (ServiceManager): Booting oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
11562024-07-25T02:08:33.107ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11572024-07-25T02:08:33.107ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11582024-07-25T02:08:33.108ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
11592024-07-25T02:08:33.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 620.674912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
11602024-07-25T02:08:33.256ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
11612024-07-25T02:08:33.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 93.421691ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
11622024-07-25T02:08:33.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 1.412949293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
11632024-07-25T02:08:33.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 972.332014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
11642024-07-25T02:08:33.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 825.634428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
11652024-07-25T02:08:33.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 42.033765ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
11662024-07-25T02:08:33.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 922.238454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
11672024-07-25T02:08:33.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 585.54505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
11682024-07-25T02:08:33.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 595.556832ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
11692024-07-25T02:08:33.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 41.405882ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
11702024-07-25T02:08:33.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 273.172822ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
11712024-07-25T02:08:33.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 873.347214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
11722024-07-25T02:08:33.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 38.700787ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
11732024-07-25T02:08:33.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 83.128301ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
11742024-07-25T02:08:33.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 122.268272ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
11752024-07-25T02:08:33.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 59.758503ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
11762024-07-25T02:08:33.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 114.046243ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
11772024-07-25T02:08:33.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 141.080048ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
11782024-07-25T02:08:33.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 1.445005634s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
11792024-07-25T02:08:33.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 163.766709ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
11802024-07-25T02:08:33.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 233.850725ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
11812024-07-25T02:08:35.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 315.871384ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
11822024-07-25T02:08:35.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 1.015951066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
11832024-07-25T02:08:35.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 723.479689ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
11842024-07-25T02:08:35.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 1.478634918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
11852024-07-25T02:08:35.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 962.385774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
11862024-07-25T02:08:35.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 1.082252082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
11872024-07-25T02:08:35.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 344.769065ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
11882024-07-25T02:08:35.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 743.241516ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
11892024-07-25T02:08:35.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.318628605s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
11902024-07-25T02:08:35.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 1.033523983s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
11912024-07-25T02:08:35.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 1.105472843s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
11922024-07-25T02:08:35.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 1.464447729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
11932024-07-25T02:08:35.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 1.465521597s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
11942024-07-25T02:08:35.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 798.385358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
11952024-07-25T02:08:35.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 791.228451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
11962024-07-25T02:08:35.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 912.91203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
11972024-07-25T02:08:35.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 589.00784ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
11982024-07-25T02:08:35.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 604.607429ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
11992024-07-25T02:08:35.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 1.117451101s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
12002024-07-25T02:08:36.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 402.810118ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
12012024-07-25T02:08:36.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.320006504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
12022024-07-25T02:08:36.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 907.982088ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
12032024-07-25T02:08:36.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 598.131997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
12042024-07-25T02:08:36.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 1.254735241s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
12052024-07-25T02:08:36.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 1.402057066s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
12062024-07-25T02:08:36.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 714.80668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
12072024-07-25T02:08:36.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 513.339691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
12082024-07-25T02:08:36.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 716.130529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
12092024-07-25T02:08:36.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 861.643207ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
12102024-07-25T02:08:36.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 812.693122ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
12112024-07-25T02:08:36.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 1.101289251s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
12122024-07-25T02:08:36.467ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12132024-07-25T02:08:36.543ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
12142024-07-25T02:08:36.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 539.764615ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
12152024-07-25T02:08:36.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 763.031887ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
12162024-07-25T02:08:36.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 618.920063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
12172024-07-25T02:08:36.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 854.851222ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
12182024-07-25T02:08:36.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 1.136617368s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
12192024-07-25T02:08:36.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 40.251196ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
12202024-07-25T02:08:36.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 739.535568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
12212024-07-25T02:08:36.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 743.647943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
12222024-07-25T02:08:36.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 1.091455828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
12232024-07-25T02:08:36.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 54.273959ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
12242024-07-25T02:08:36.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 266.779695ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
12252024-07-25T02:08:37.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 745.683701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
12262024-07-25T02:08:37.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 549.645118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
12272024-07-25T02:08:37.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 1.183327197s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
12282024-07-25T02:08:37.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 718.893769ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
12292024-07-25T02:08:37.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 571.293966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
12302024-07-25T02:08:37.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 226.352032ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
12312024-07-25T02:08:37.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 1.351029521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
12322024-07-25T02:08:37.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 1.359207549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
12332024-07-25T02:08:37.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.312702619s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
12342024-07-25T02:08:37.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 1.01505265s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
12352024-07-25T02:08:37.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 682.646377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
12362024-07-25T02:08:37.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 1.030495412s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
12372024-07-25T02:08:37.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 1.294268366s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
12382024-07-25T02:08:37.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 1.064549684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
12392024-07-25T02:08:37.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 814.146985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
12402024-07-25T02:08:37.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 898.709089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
12412024-07-25T02:08:37.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 1.482643163s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
12422024-07-25T02:08:37.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 1.207888216s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
12432024-07-25T02:08:37.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 989.69348ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
12442024-07-25T02:08:37.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 647.654337ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
12452024-07-25T02:08:37.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 794.569219ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
12462024-07-25T02:08:37.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 1.206376686s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
12472024-07-25T02:08:37.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 745.228881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
12482024-07-25T02:08:38.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.104189597s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
12492024-07-25T02:08:38.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 1.498171459s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
12502024-07-25T02:08:38.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 1.21681498s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
12512024-07-25T02:08:38.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 791.772831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
12522024-07-25T02:08:38.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 1.402040004s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
12532024-07-25T02:08:38.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 1.061959708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
12542024-07-25T02:08:38.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 1.014112379s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
12552024-07-25T02:08:38.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 1.059147215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
12562024-07-25T02:08:38.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 1.057663834s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
12572024-07-25T02:08:38.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 1.202800411s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
12582024-07-25T02:08:38.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 514.517247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
12592024-07-25T02:08:38.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 827.043274ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
12602024-07-25T02:08:38.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 990.464457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
12612024-07-25T02:08:38.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 928.633782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
12622024-07-25T02:08:38.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 668.045959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
12632024-07-25T02:08:38.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 700.273981ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
12642024-07-25T02:08:39.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 1.169499375s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
12652024-07-25T02:08:39.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 938.550668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
12662024-07-25T02:08:39.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 1.488628566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
12672024-07-25T02:08:39.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 884.277889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
12682024-07-25T02:08:39.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.387003291s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
12692024-07-25T02:08:39.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 1.353427127s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
12702024-07-25T02:08:39.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 668.394803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
12712024-07-25T02:08:39.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 1.066521942s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
12722024-07-25T02:08:39.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.234160474s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
12732024-07-25T02:08:39.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 658.695917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
12742024-07-25T02:08:39.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 1.248540214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
12752024-07-25T02:08:39.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 925.456997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
12762024-07-25T02:08:39.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 1.417301794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
12772024-07-25T02:08:39.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 645.97889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
12782024-07-25T02:08:39.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 508.484174ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
12792024-07-25T02:08:39.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 812.414718ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
12802024-07-25T02:08:40.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 1.364455572s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
12812024-07-25T02:08:40.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 1.205825596s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
12822024-07-25T02:08:40.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 1.332624545s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
12832024-07-25T02:08:40.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 818.318394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
12842024-07-25T02:08:40.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 608.897409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
12852024-07-25T02:08:40.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 1.134471548s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
12862024-07-25T02:08:40.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 799.655441ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
12872024-07-25T02:08:40.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 561.550842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
12882024-07-25T02:08:40.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 818.418946ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
12892024-07-25T02:08:40.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 1.116695123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
12902024-07-25T02:08:40.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 522.331744ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
12912024-07-25T02:08:40.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 1.394396887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
12922024-07-25T02:08:40.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.115928594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
12932024-07-25T02:08:40.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 563.049168ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
12942024-07-25T02:08:40.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 1.427535413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
12952024-07-25T02:08:40.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 817.670706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
12962024-07-25T02:08:40.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 923.297881ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
12972024-07-25T02:08:40.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 727.796546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
12982024-07-25T02:08:41.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 969.523985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
12992024-07-25T02:08:41.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 1.232919655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
13002024-07-25T02:08:41.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 701.096865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
13012024-07-25T02:08:41.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 594.064889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
13022024-07-25T02:08:41.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 781.203217ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
13032024-07-25T02:08:41.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 727.102518ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
13042024-07-25T02:08:41.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 856.889483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
13052024-07-25T02:08:41.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 921.234059ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
13062024-07-25T02:08:41.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 958.98495ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
13072024-07-25T02:08:41.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 1.37505715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
13082024-07-25T02:08:41.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 556.250129ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
13092024-07-25T02:08:41.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 1.195880204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
13102024-07-25T02:08:41.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 1.180545749s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
13112024-07-25T02:08:41.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 1.463341448s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
13122024-07-25T02:08:41.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 938.592937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
13132024-07-25T02:08:41.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 801.381928ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
13142024-07-25T02:08:41.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 750.248803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
13152024-07-25T02:08:41.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 896.774599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
13162024-07-25T02:08:41.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 1.400589323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
13172024-07-25T02:08:42.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 963.556935ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
13182024-07-25T02:08:42.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 1.114671247s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
13192024-07-25T02:08:42.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 584.529807ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
13202024-07-25T02:08:42.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 539.8335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
13212024-07-25T02:08:42.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 1.195243554s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
13222024-07-25T02:08:42.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 723.231798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
13232024-07-25T02:08:42.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 876.913142ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
13242024-07-25T02:08:42.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 1.269773944s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
13252024-07-25T02:08:42.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 804.528004ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
13262024-07-25T02:08:42.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 1.311625464s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
13272024-07-25T02:08:42.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 597.355795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
13282024-07-25T02:08:42.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.420814651s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
13292024-07-25T02:08:42.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 1.225288462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
13302024-07-25T02:08:42.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 1.282936961s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
13312024-07-25T02:08:42.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.461321175s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
13322024-07-25T02:08:42.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 836.046984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
13332024-07-25T02:08:42.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 1.235874015s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
13342024-07-25T02:08:42.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 1.050142371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
13352024-07-25T02:08:43.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 898.716596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
13362024-07-25T02:08:43.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 1.372979352s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
13372024-07-25T02:08:43.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 716.35533ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
13382024-07-25T02:08:43.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 1.172636809s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
13392024-07-25T02:08:43.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 1.490701253s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
13402024-07-25T02:08:43.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 886.263429ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
13412024-07-25T02:08:43.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 818.353004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
13422024-07-25T02:08:43.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 733.150704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
13432024-07-25T02:08:43.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 560.376472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
13442024-07-25T02:08:43.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 1.321902734s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
13452024-07-25T02:08:43.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 1.315953244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
13462024-07-25T02:08:43.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 554.410066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
13472024-07-25T02:08:43.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 517.528358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
13482024-07-25T02:08:43.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 515.371024ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
13492024-07-25T02:08:44.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 729.029767ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
13502024-07-25T02:08:44.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 956.964097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
13512024-07-25T02:08:44.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 1.429017372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
13522024-07-25T02:08:44.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 626.737055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
13532024-07-25T02:08:44.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.290220048s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
13542024-07-25T02:08:44.146ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552024-07-25T02:08:44.156ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93 zone file = illumos-utils/src/running_zone.rs:465 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
13562024-07-25T02:08:44.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 1.25747433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
13572024-07-25T02:08:44.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 1.24675579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
13582024-07-25T02:08:44.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 1.167260312s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
13592024-07-25T02:08:44.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 1.44104385s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
13602024-07-25T02:08:44.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.279334946s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
13612024-07-25T02:08:44.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 34.687832ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
13622024-07-25T02:08:44.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 1.478492955s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
13632024-07-25T02:08:44.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 78.768518ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
13642024-07-25T02:08:44.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 1.220487792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
13652024-07-25T02:08:44.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 1.029784025s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
13662024-07-25T02:08:44.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 137.437539ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
13672024-07-25T02:08:44.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 658.626795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
13682024-07-25T02:08:44.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 987.280468ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
13692024-07-25T02:08:44.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 263.887047ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
13702024-07-25T02:08:44.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 557.386068ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
13712024-07-25T02:08:44.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 1.381042177s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
13722024-07-25T02:08:44.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 748.430851ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
13732024-07-25T02:08:44.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 991.546605ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
13742024-07-25T02:08:44.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 956.794634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
13752024-07-25T02:08:44.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 1.277897439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
13762024-07-25T02:08:45.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 666.518719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
13772024-07-25T02:08:45.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 831.210459ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
13782024-07-25T02:08:45.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 620.562172ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
13792024-07-25T02:08:45.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 991.537354ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
13802024-07-25T02:08:45.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.24803259s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
13812024-07-25T02:08:45.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 732.08826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
13822024-07-25T02:08:45.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 508.726279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
13832024-07-25T02:08:45.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 1.26163804s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
13842024-07-25T02:08:45.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 1.255069922s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
13852024-07-25T02:08:45.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 1.407149594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
13862024-07-25T02:08:45.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 982.838759ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
13872024-07-25T02:08:45.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.219161081s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
13882024-07-25T02:08:45.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 698.469501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
13892024-07-25T02:08:45.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 675.755671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
13902024-07-25T02:08:45.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 1.120246485s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
13912024-07-25T02:08:45.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 1.184306123s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
13922024-07-25T02:08:45.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 1.259869981s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
13932024-07-25T02:08:45.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 867.923078ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
13942024-07-25T02:08:45.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 776.294376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
13952024-07-25T02:08:45.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 1.046715974s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
13962024-07-25T02:08:46.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 1.362877123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
13972024-07-25T02:08:46.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 700.114949ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
13982024-07-25T02:08:46.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 1.486924135s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
13992024-07-25T02:08:46.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 1.036541969s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
14002024-07-25T02:08:46.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 1.316054076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
14012024-07-25T02:08:46.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 1.138369047s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
14022024-07-25T02:08:46.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 933.07366ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
14032024-07-25T02:08:46.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 695.932357ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
14042024-07-25T02:08:46.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.044951779s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
14052024-07-25T02:08:46.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 1.008519289s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
14062024-07-25T02:08:46.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 1.224676585s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
14072024-07-25T02:08:46.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 906.649547ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
14082024-07-25T02:08:46.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 919.683616ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
14092024-07-25T02:08:46.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 889.702931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
14102024-07-25T02:08:46.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 1.123213502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
14112024-07-25T02:08:46.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 680.317436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
14122024-07-25T02:08:46.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 537.490167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
14132024-07-25T02:08:47.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 1.436891613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
14142024-07-25T02:08:47.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 602.972249ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
14152024-07-25T02:08:47.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 779.23014ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
14162024-07-25T02:08:47.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 511.991105ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
14172024-07-25T02:08:47.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 1.066370445s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
14182024-07-25T02:08:47.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 1.160014058s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
14192024-07-25T02:08:47.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 681.445237ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
14202024-07-25T02:08:47.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 1.403418152s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
14212024-07-25T02:08:47.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 933.060973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
14222024-07-25T02:08:47.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 581.76829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
14232024-07-25T02:08:47.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 892.998141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
14242024-07-25T02:08:47.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 1.084215508s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
14252024-07-25T02:08:47.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 708.553149ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
14262024-07-25T02:08:47.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 789.344764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
14272024-07-25T02:08:47.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 610.393841ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
14282024-07-25T02:08:47.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 729.316319ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
14292024-07-25T02:08:47.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 1.236306442s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
14302024-07-25T02:08:47.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 567.466157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
14312024-07-25T02:08:47.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 1.151876639s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
14322024-07-25T02:08:47.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 995.935436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
14332024-07-25T02:08:48.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 659.09085ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
14342024-07-25T02:08:48.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 1.302706221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
14352024-07-25T02:08:48.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 678.054369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
14362024-07-25T02:08:48.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 1.306462599s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
14372024-07-25T02:08:48.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 1.224477503s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
14382024-07-25T02:08:48.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.018876934s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
14392024-07-25T02:08:48.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 763.96104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
14402024-07-25T02:08:48.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 1.036093313s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
14412024-07-25T02:08:48.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 834.178766ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
14422024-07-25T02:08:48.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.099624761s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
14432024-07-25T02:08:48.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 665.96788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
14442024-07-25T02:08:48.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 949.017188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
14452024-07-25T02:08:48.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 1.204640572s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
14462024-07-25T02:08:48.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 735.635819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
14472024-07-25T02:08:48.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 1.213999676s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
14482024-07-25T02:08:48.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 1.411479919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
14492024-07-25T02:08:48.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 1.14081029s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
14502024-07-25T02:08:48.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 1.473004262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
14512024-07-25T02:08:48.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 1.011239309s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
14522024-07-25T02:08:49.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 764.787992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
14532024-07-25T02:08:49.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 1.030777195s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
14542024-07-25T02:08:49.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 1.335433603s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
14552024-07-25T02:08:49.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 1.139147678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
14562024-07-25T02:08:49.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 1.322350159s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
14572024-07-25T02:08:49.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 1.4246167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
14582024-07-25T02:08:49.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 969.383216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
14592024-07-25T02:08:49.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.110753375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
14602024-07-25T02:08:49.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 756.956721ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
14612024-07-25T02:08:49.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 1.361541946s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
14622024-07-25T02:08:49.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 894.354293ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
14632024-07-25T02:08:49.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 746.00037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
14642024-07-25T02:08:49.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 802.550109ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
14652024-07-25T02:08:49.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 1.395510621s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
14662024-07-25T02:08:49.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 847.931782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
14672024-07-25T02:08:49.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 608.005831ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
14682024-07-25T02:08:49.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 867.07322ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
14692024-07-25T02:08:50.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 1.082027279s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
14702024-07-25T02:08:50.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 880.134508ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
14712024-07-25T02:08:50.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 1.246609925s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
14722024-07-25T02:08:50.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 500.079237ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
14732024-07-25T02:08:50.265ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.455588617s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
14742024-07-25T02:08:50.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0") failed: Property not found. retry in 1.282732101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
14752024-07-25T02:08:50.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 1.24628296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
14762024-07-25T02:08:50.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb") failed: Property not found. retry in 592.187612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
14772024-07-25T02:08:50.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f") failed: Property not found. retry in 841.240002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
14782024-07-25T02:08:50.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 1.256943445s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
14792024-07-25T02:08:50.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.134399552s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
14802024-07-25T02:08:50.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.250482534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
14812024-07-25T02:08:50.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 1.288730143s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
14822024-07-25T02:08:50.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 1.000783943s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
14832024-07-25T02:08:50.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 875.936191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
14842024-07-25T02:08:50.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 1.276179619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
14852024-07-25T02:08:50.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 1.057078799s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
14862024-07-25T02:08:50.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 790.739005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
14872024-07-25T02:08:50.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 1.350101249s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
14882024-07-25T02:08:50.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 507.533607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
14892024-07-25T02:08:50.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 771.311402ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
14902024-07-25T02:08:51.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 896.017835ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
14912024-07-25T02:08:51.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461") failed: Property not found. retry in 951.986919ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
14922024-07-25T02:08:51.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 1.073895384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
14932024-07-25T02:08:51.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 793.193918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
14942024-07-25T02:08:51.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 539.53651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
14952024-07-25T02:08:51.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 1.063260345s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
14962024-07-25T02:08:51.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.023191739s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
14972024-07-25T02:08:51.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 1.009274819s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
14982024-07-25T02:08:51.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b") failed: Property not found. retry in 891.099688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
14992024-07-25T02:08:51.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020") failed: Property not found. retry in 1.110893299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
15002024-07-25T02:08:51.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 1.15324064s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
15012024-07-25T02:08:51.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.141353324s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
15022024-07-25T02:08:51.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2") failed: Property not found. retry in 1.355370453s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
15032024-07-25T02:08:51.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 562.789119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
15042024-07-25T02:08:51.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243") failed: Property not found. retry in 675.272431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
15052024-07-25T02:08:52.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 657.326895ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
15062024-07-25T02:08:52.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 792.556397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
15072024-07-25T02:08:52.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159") failed: Property not found. retry in 1.234112183s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
15082024-07-25T02:08:52.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 766.500691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
15092024-07-25T02:08:52.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27") failed: Property not found. retry in 1.171416204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
15102024-07-25T02:08:52.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb") failed: Property not found. retry in 1.219507911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
15112024-07-25T02:08:52.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48") failed: Property not found. retry in 504.326082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
15122024-07-25T02:08:52.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2") failed: Property not found. retry in 1.45610597s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
15132024-07-25T02:08:52.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 836.667619ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
15142024-07-25T02:08:52.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47") failed: Property not found. retry in 640.547617ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
15152024-07-25T02:08:52.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e") failed: Property not found. retry in 781.556009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
15162024-07-25T02:08:52.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d") failed: Property not found. retry in 1.38421783s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
15172024-07-25T02:08:52.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435") failed: Property not found. retry in 1.253614012s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
15182024-07-25T02:08:53.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b") failed: Property not found. retry in 564.094804ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
15192024-07-25T02:08:53.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93") failed: Property not found. retry in 1.132292494s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
15202024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_external_dns_9f058198-eda8-4c0e-b8ea-30eb0b528159
15212024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_external_dns_f4b3f798-a13c-49e1-99a7-fd75c3def461
15222024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_pantry_7f18ebb9-c046-4795-b463-fe098a9111eb
15232024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_d275e9ef-209a-4386-8746-e2654671f435
15242024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_d2da6631-7332-419f-87ad-4498ea3b0b27
15252024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_a65f784e-83be-44ce-a73c-a4800feee020
15262024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_6fe3427d-861d-4413-a2f2-00f0ef53c243
15272024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_nexus_e2911521-a3ee-44ca-b0d0-d76b758cadb2
15282024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_nexus_594bcd89-4b8f-4545-902d-96c524c9339d
15292024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_oximeter_ffda95b3-f1f2-4ab1-abeb-93469c954af2
15302024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_clickhouse_7ad9bf24-25f9-41ea-a0a2-7e9eda9a4e93
15312024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_pantry_a991046c-7ae8-416c-ac68-e4e10ce104a0
15322024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_pantry_afe4f4fc-0d66-4665-ba04-4246e5e90f2b
15332024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_89bf7581-a9a9-4f0b-8cea-ab94c858c51f
15342024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_dab49687-4a1d-454d-86fa-c5dbd1f53b48
15352024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_84ba098c-f858-42b0-a745-87982cf97f8e
15362024-07-25T02:08:54.680ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_69b87776-767f-4899-8b21-1eaa71b3a9bb
15372024-07-25T02:08:54.681ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_crucible_2d8d8175-d54b-4fc7-8234-c018bc6ce25b
15382024-07-25T02:08:54.681ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3062 zone = oxz_nexus_4cc78cbb-766f-4dce-b83d-e0ce8e85fc47
15392024-07-25T02:08:54.689ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15402024-07-25T02:08:54.697ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15412024-07-25T02:08:54.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 37820566 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55996 req_id = ff994f21-4b72-4e47-9b83-a9da7343e44f response_code = 204 uri = /omicron-zones
15422024-07-25T02:08:54.725ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1250
15432024-07-25T02:08:54.726ZINFOSledAgent (RSS): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15442024-07-25T02:08:54.726ZINFOSledAgent (RSS): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15452024-07-25T02:08:54.733ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:687
15462024-07-25T02:08:54.744ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:700
15472024-07-25T02:08:54.804ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:831
15482024-07-25T02:08:55.297ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15492024-07-25T02:08:55.299ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.87037364s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
15502024-07-25T02:08:55.393ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15512024-07-25T02:08:55.548ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15522024-07-25T02:08:55.673ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15532024-07-25T02:08:55.859ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42228
15542024-07-25T02:08:55.859ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 164 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42228 req_id = f5bb51d2-4ac1-4ff9-9669-52780d42e451 response_code = 200 uri = /baseboard
15552024-07-25T02:08:55.890ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15562024-07-25T02:08:56.156ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15572024-07-25T02:08:56.326ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15582024-07-25T02:08:56.695ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15592024-07-25T02:08:57.129ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15602024-07-25T02:08:57.735ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15612024-07-25T02:08:58.299ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15622024-07-25T02:08:58.834ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15632024-07-25T02:08:59.624ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15642024-07-25T02:09:00.620ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15652024-07-25T02:09:01.206ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.828687553s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
15662024-07-25T02:09:01.315ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15672024-07-25T02:09:02.626ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15682024-07-25T02:09:03.908ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/825b5b0d-f19c-424b-b303-3d278997ebd5/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:893
15692024-07-25T02:09:06.702ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f8742527-ba77-469a-bc0b-ff8f618a091b", "content-length": "173", "date": "Thu, 25 Jul 2024 02:09:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"825b5b0d-f19c-424b-b303-3d278997ebd5\"", request_id: "f8742527-ba77-469a-bc0b-ff8f618a091b" } file = sled-agent/src/rack_setup/service.rs:893
15702024-07-25T02:09:10.325ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "06543fa1-76b2-4cc0-9ae7-88bb76e9de4a", "content-length": "173", "date": "Thu, 25 Jul 2024 02:09:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"95f9e969-8f6f-4c75-9a0a-2e70695a1940\"", request_id: "06543fa1-76b2-4cc0-9ae7-88bb76e9de4a" } file = sled-agent/src/rack_setup/service.rs:893
15712024-07-25T02:09:12.085ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ffcbc73c-db46-4687-866e-7ea31befccc0", "content-length": "173", "date": "Thu, 25 Jul 2024 02:09:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"95f9e969-8f6f-4c75-9a0a-2e70695a1940\"", request_id: "ffcbc73c-db46-4687-866e-7ea31befccc0" } file = sled-agent/src/rack_setup/service.rs:893
15722024-07-25T02:09:14.476ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1210b18c-f041-4284-bf78-a4f909c8bedd", "content-length": "173", "date": "Thu, 25 Jul 2024 02:09:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"95f9e969-8f6f-4c75-9a0a-2e70695a1940\"", request_id: "1210b18c-f041-4284-bf78-a4f909c8bedd" } file = sled-agent/src/rack_setup/service.rs:893
15732024-07-25T02:09:16.769ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "672cf5d7-73fa-40d3-8d1d-119d1994a3e7", "content-length": "173", "date": "Thu, 25 Jul 2024 02:09:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"95f9e969-8f6f-4c75-9a0a-2e70695a1940\"", request_id: "672cf5d7-73fa-40d3-8d1d-119d1994a3e7" } file = sled-agent/src/rack_setup/service.rs:893
15742024-07-25T02:09:20.310ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d8208258-1abb-4a2f-b600-0db480dcc2af", "content-length": "173", "date": "Thu, 25 Jul 2024 02:09:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"95f9e969-8f6f-4c75-9a0a-2e70695a1940\"", request_id: "d8208258-1abb-4a2f-b600-0db480dcc2af" } file = sled-agent/src/rack_setup/service.rs:893
15752024-07-25T02:09:25.897ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42755
15762024-07-25T02:09:25.897ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42755 req_id = 8d034985-47eb-4e97-8133-fe15b12079cb response_code = 200 uri = /baseboard
15772024-07-25T02:09:27.106ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8f129406-87e2-4a60-870d-13c8f88f412c", "content-length": "173", "date": "Thu, 25 Jul 2024 02:09:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"95f9e969-8f6f-4c75-9a0a-2e70695a1940\"", request_id: "8f129406-87e2-4a60-870d-13c8f88f412c" } file = sled-agent/src/rack_setup/service.rs:893
15782024-07-25T02:09:37.215ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "13488f11-abb0-4a10-94f0-a8219bdf0175", "content-length": "173", "date": "Thu, 25 Jul 2024 02:09:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"95f9e969-8f6f-4c75-9a0a-2e70695a1940\"", request_id: "13488f11-abb0-4a10-94f0-a8219bdf0175" } file = sled-agent/src/rack_setup/service.rs:893
15792024-07-25T02:09:43.169ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:40117 remote_addr = [fd00:1122:3344:101::d]:32985 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
15802024-07-25T02:09:43.176ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 5145 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = f0d5d44b-9a89-4511-8e45-b7bdd159c9a0 response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
15812024-07-25T02:09:45.291ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:573 new_generation = 1 old_generation = 1 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940
15822024-07-25T02:09:45.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63232
15832024-07-25T02:09:45.429ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
15842024-07-25T02:09:45.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 89740 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63232 req_id = 68616877-5cab-4bcb-9f3a-a4cfd7f13ca3 response_code = 200 uri = /inventory
15852024-07-25T02:09:45.518ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
15862024-07-25T02:09:45.518ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-zones.json file = common/src/ledger.rs:177
15872024-07-25T02:09:45.522ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-zones.json file = common/src/ledger.rs:177
15882024-07-25T02:09:45.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 5266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63232 req_id = 359ea08e-2b3f-4c41-ad53-ea7432d6e6b0 response_code = 200 uri = /omicron-zones
15892024-07-25T02:09:49.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55940
15902024-07-25T02:09:49.757ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2660255a-6e82-49c7-ae2e-1d3c92d8bd9d, kind: Service { id: 9f058198-eda8-4c0e-b8ea-30eb0b528159 }, name: Name("external-dns-9f058198-eda8-4c0e-b8ea-30eb0b528159"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6d1a80-5286-4c9f-95df-8068ad02f390, kind: Service { id: f4b3f798-a13c-49e1-99a7-fd75c3def461 }, name: Name("external-dns-f4b3f798-a13c-49e1-99a7-fd75c3def461"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 95])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c79351b-16e9-49a1-99bb-1ac9e3bb56dd, kind: Service { id: 4cc78cbb-766f-4dce-b83d-e0ce8e85fc47 }, name: Name("nexus-4cc78cbb-766f-4dce-b83d-e0ce8e85fc47"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c7afaa5-efdb-419d-8129-1c41d624f824, kind: Service { id: 594bcd89-4b8f-4545-902d-96c524c9339d }, name: Name("nexus-594bcd89-4b8f-4545-902d-96c524c9339d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 508f9e23-8d99-43a2-aeb6-2134550fe4a5, kind: Service { id: e2911521-a3ee-44ca-b0d0-d76b758cadb2 }, name: Name("nexus-e2911521-a3ee-44ca-b0d0-d76b758cadb2"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15912024-07-25T02:09:49.757ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15922024-07-25T02:09:49.758ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15932024-07-25T02:09:49.758ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15942024-07-25T02:09:49.758ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15952024-07-25T02:09:49.758ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15962024-07-25T02:09:49.758ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
15972024-07-25T02:09:49.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 4167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55940 req_id = ac622a53-0255-48e2-82e0-6ff92555b328 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15982024-07-25T02:09:49.760ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:903
15992024-07-25T02:09:49.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59807
16002024-07-25T02:09:49.863ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2660255a-6e82-49c7-ae2e-1d3c92d8bd9d, kind: Service { id: 9f058198-eda8-4c0e-b8ea-30eb0b528159 }, name: Name("external-dns-9f058198-eda8-4c0e-b8ea-30eb0b528159"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6d1a80-5286-4c9f-95df-8068ad02f390, kind: Service { id: f4b3f798-a13c-49e1-99a7-fd75c3def461 }, name: Name("external-dns-f4b3f798-a13c-49e1-99a7-fd75c3def461"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 95])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c79351b-16e9-49a1-99bb-1ac9e3bb56dd, kind: Service { id: 4cc78cbb-766f-4dce-b83d-e0ce8e85fc47 }, name: Name("nexus-4cc78cbb-766f-4dce-b83d-e0ce8e85fc47"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c7afaa5-efdb-419d-8129-1c41d624f824, kind: Service { id: 594bcd89-4b8f-4545-902d-96c524c9339d }, name: Name("nexus-594bcd89-4b8f-4545-902d-96c524c9339d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 508f9e23-8d99-43a2-aeb6-2134550fe4a5, kind: Service { id: e2911521-a3ee-44ca-b0d0-d76b758cadb2 }, name: Name("nexus-e2911521-a3ee-44ca-b0d0-d76b758cadb2"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16012024-07-25T02:09:49.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16022024-07-25T02:09:49.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16032024-07-25T02:09:49.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16042024-07-25T02:09:49.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16052024-07-25T02:09:49.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16062024-07-25T02:09:49.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
16072024-07-25T02:09:49.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59807 req_id = f631a05c-a659-4b0b-8a18-8f3835003bb7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16082024-07-25T02:09:49.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54554
16092024-07-25T02:09:49.865ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2660255a-6e82-49c7-ae2e-1d3c92d8bd9d, kind: Service { id: 9f058198-eda8-4c0e-b8ea-30eb0b528159 }, name: Name("external-dns-9f058198-eda8-4c0e-b8ea-30eb0b528159"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6d1a80-5286-4c9f-95df-8068ad02f390, kind: Service { id: f4b3f798-a13c-49e1-99a7-fd75c3def461 }, name: Name("external-dns-f4b3f798-a13c-49e1-99a7-fd75c3def461"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 95])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c79351b-16e9-49a1-99bb-1ac9e3bb56dd, kind: Service { id: 4cc78cbb-766f-4dce-b83d-e0ce8e85fc47 }, name: Name("nexus-4cc78cbb-766f-4dce-b83d-e0ce8e85fc47"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c7afaa5-efdb-419d-8129-1c41d624f824, kind: Service { id: 594bcd89-4b8f-4545-902d-96c524c9339d }, name: Name("nexus-594bcd89-4b8f-4545-902d-96c524c9339d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 508f9e23-8d99-43a2-aeb6-2134550fe4a5, kind: Service { id: e2911521-a3ee-44ca-b0d0-d76b758cadb2 }, name: Name("nexus-e2911521-a3ee-44ca-b0d0-d76b758cadb2"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16102024-07-25T02:09:49.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16112024-07-25T02:09:49.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16122024-07-25T02:09:49.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16132024-07-25T02:09:49.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16142024-07-25T02:09:49.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16152024-07-25T02:09:49.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
16162024-07-25T02:09:49.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54554 req_id = e4c50b33-a400-4dd0-86ea-908b187db083 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16172024-07-25T02:09:49.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49791
16182024-07-25T02:09:49.948ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2660255a-6e82-49c7-ae2e-1d3c92d8bd9d, kind: Service { id: 9f058198-eda8-4c0e-b8ea-30eb0b528159 }, name: Name("external-dns-9f058198-eda8-4c0e-b8ea-30eb0b528159"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6d1a80-5286-4c9f-95df-8068ad02f390, kind: Service { id: f4b3f798-a13c-49e1-99a7-fd75c3def461 }, name: Name("external-dns-f4b3f798-a13c-49e1-99a7-fd75c3def461"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 95])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c79351b-16e9-49a1-99bb-1ac9e3bb56dd, kind: Service { id: 4cc78cbb-766f-4dce-b83d-e0ce8e85fc47 }, name: Name("nexus-4cc78cbb-766f-4dce-b83d-e0ce8e85fc47"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c7afaa5-efdb-419d-8129-1c41d624f824, kind: Service { id: 594bcd89-4b8f-4545-902d-96c524c9339d }, name: Name("nexus-594bcd89-4b8f-4545-902d-96c524c9339d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 508f9e23-8d99-43a2-aeb6-2134550fe4a5, kind: Service { id: e2911521-a3ee-44ca-b0d0-d76b758cadb2 }, name: Name("nexus-e2911521-a3ee-44ca-b0d0-d76b758cadb2"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16192024-07-25T02:09:49.948ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16202024-07-25T02:09:49.948ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16212024-07-25T02:09:49.948ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16222024-07-25T02:09:49.948ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16232024-07-25T02:09:49.948ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16242024-07-25T02:09:49.948ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
16252024-07-25T02:09:49.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 838 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49791 req_id = 86077a09-57d4-48de-97a1-f19318359900 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16262024-07-25T02:09:49.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53488
16272024-07-25T02:09:49.969ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
16282024-07-25T02:09:50.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 91176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53488 req_id = 19c730b5-1045-47ac-9bcf-277f9d923b0b response_code = 200 uri = /inventory
16292024-07-25T02:09:50.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
16302024-07-25T02:09:50.061ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/config/omicron-zones.json file = common/src/ledger.rs:177
16312024-07-25T02:09:50.061ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/config/omicron-zones.json file = common/src/ledger.rs:177
16322024-07-25T02:09:50.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53488 req_id = a46e1b3f-0cf1-4d07-8d29-7379f698ec53 response_code = 200 uri = /omicron-zones
16332024-07-25T02:09:53.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52497
16342024-07-25T02:09:53.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 549 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52497 req_id = d1c06029-d975-4565-8c3f-aec735db71f9 response_code = 200 uri = /vpc-routes
16352024-07-25T02:09:53.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1789 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52497 req_id = 5dbe4dac-d8f5-43f8-862c-f4b1b7e5e880 response_code = 204 uri = /vpc-routes
16362024-07-25T02:09:55.931ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35843
16372024-07-25T02:09:55.931ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 79 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35843 req_id = 173feff4-0629-42e2-aadf-136c25ee13dc response_code = 200 uri = /baseboard
16382024-07-25T02:10:06.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37658
16392024-07-25T02:10:06.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1681 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37658 req_id = c46f3726-60f4-4585-ae89-762406e5db27 response_code = 200 uri = /v2p
16402024-07-25T02:10:06.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49512
16412024-07-25T02:10:06.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49512 req_id = 560ec3e4-e4c9-407d-a749-80a7c46acd36 response_code = 200 uri = /vpc-routes
16422024-07-25T02:10:06.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49512 req_id = 008d96fc-c130-486d-ab49-91b3ec6ff00f response_code = 204 uri = /vpc-routes
16432024-07-25T02:10:06.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62713
16442024-07-25T02:10:06.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62713 req_id = aeeb124a-59ea-4396-8212-0db1e72ad33d response_code = 200 uri = /vpc-routes
16452024-07-25T02:10:06.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62713 req_id = 28076d67-891b-46fa-b7d3-5b46e8ca9577 response_code = 204 uri = /vpc-routes
16462024-07-25T02:10:06.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47570
16472024-07-25T02:10:06.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 988 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47570 req_id = bcb4925a-6c01-448e-bafc-bb4201dc3201 response_code = 200 uri = /v2p
16482024-07-25T02:10:06.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47643
16492024-07-25T02:10:06.856ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
16502024-07-25T02:10:06.930ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
16512024-07-25T02:10:06.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 103700 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47643 req_id = 7c544f49-4ff5-4574-a760-e32a3a284660 response_code = 204 uri = /switch-ports
16522024-07-25T02:10:06.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51923
16532024-07-25T02:10:06.961ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
16542024-07-25T02:10:06.989ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
16552024-07-25T02:10:07.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 63744 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51923 req_id = fc240876-61b5-4b59-83d7-076f39c16717 response_code = 204 uri = /switch-ports
16562024-07-25T02:10:07.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 3203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47643 req_id = 88eafd52-0e84-4258-80ef-467c4518ef99 response_code = 200 uri = /network-bootstore-config
16572024-07-25T02:10:07.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51923 req_id = d32fae65-c85b-4b11-b3be-951de3c6b3e0 response_code = 200 uri = /network-bootstore-config
16582024-07-25T02:10:07.046ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
16592024-07-25T02:10:07.046ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16602024-07-25T02:10:07.048ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16612024-07-25T02:10:07.049ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
16622024-07-25T02:10:07.049ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
16632024-07-25T02:10:07.049ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16642024-07-25T02:10:07.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 3062 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47643 req_id = 4e4149c1-fc2b-450d-9bc5-7121de1b514d response_code = 204 uri = /network-bootstore-config
16652024-07-25T02:10:07.049ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16662024-07-25T02:10:07.049ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
16672024-07-25T02:10:07.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1610 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51923 req_id = 25cca183-26b9-4a75-b700-46b5ac75c8ec response_code = 204 uri = /network-bootstore-config
16682024-07-25T02:10:07.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47684
16692024-07-25T02:10:07.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47684 req_id = ee9b905f-e125-4902-9b13-2ba4fe517de1 response_code = 200 uri = /vpc-routes
16702024-07-25T02:10:07.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46725
16712024-07-25T02:10:07.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46725 req_id = 4231a04c-6153-41d6-851b-a771109b6444 response_code = 200 uri = /v2p
16722024-07-25T02:10:07.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47684 req_id = 395369e0-d3b6-453b-931a-d068d67e7d35 response_code = 204 uri = /vpc-routes
16732024-07-25T02:10:07.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41924
16742024-07-25T02:10:07.468ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
16752024-07-25T02:10:07.495ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
16762024-07-25T02:10:07.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 51857 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41924 req_id = f918dc54-44d8-498f-90b3-04b725999735 response_code = 204 uri = /switch-ports
16772024-07-25T02:10:07.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41924 req_id = bdfc68af-e501-4339-b7d3-300e94497f71 response_code = 200 uri = /network-bootstore-config
16782024-07-25T02:10:13.170ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1707 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = 5387ebae-b3ad-40d7-94fe-b0fb821583e0 response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
16792024-07-25T02:10:25.963ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49943
16802024-07-25T02:10:25.963ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 93 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49943 req_id = 129b8e7e-1f41-484d-bb53-707479b87d2a response_code = 200 uri = /baseboard
16812024-07-25T02:10:36.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37914
16822024-07-25T02:10:36.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37914 req_id = ec73c4b2-ff8e-49da-a2fc-532f67a65059 response_code = 200 uri = /vpc-routes
16832024-07-25T02:10:36.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37914 req_id = fee84dd9-80ab-4c5c-854d-6650ad84ee36 response_code = 204 uri = /vpc-routes
16842024-07-25T02:10:36.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51683
16852024-07-25T02:10:36.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 880 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51683 req_id = 1783164e-44b5-42f1-9363-09a96cdb9395 response_code = 200 uri = /vpc-routes
16862024-07-25T02:10:36.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51683 req_id = 2e30c3cf-4230-4ba2-8695-3e1ba2f742af response_code = 204 uri = /vpc-routes
16872024-07-25T02:10:36.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42999
16882024-07-25T02:10:36.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42999 req_id = 1c6e4e09-e98e-48b1-898e-ed56370530d9 response_code = 200 uri = /v2p
16892024-07-25T02:10:36.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57580
16902024-07-25T02:10:36.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57580 req_id = f0cb3c3a-1f19-468c-8761-546e50b12458 response_code = 200 uri = /v2p
16912024-07-25T02:10:36.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51534
16922024-07-25T02:10:36.498ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
16932024-07-25T02:10:36.523ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
16942024-07-25T02:10:36.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 50134 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51534 req_id = a83ee6b0-e21f-4607-b87f-817c88436936 response_code = 204 uri = /switch-ports
16952024-07-25T02:10:36.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51534 req_id = 9726f8d6-b9ec-42e4-bdd5-09f8abf133b7 response_code = 200 uri = /network-bootstore-config
16962024-07-25T02:10:36.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63375
16972024-07-25T02:10:36.592ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
16982024-07-25T02:10:36.615ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
16992024-07-25T02:10:36.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 45592 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63375 req_id = 744ad6ff-135d-4ec2-9371-90260852edab response_code = 204 uri = /switch-ports
17002024-07-25T02:10:36.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63375 req_id = 6825588e-f80d-4b92-a303-ce1da3574c5b response_code = 200 uri = /network-bootstore-config
17012024-07-25T02:10:36.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55993
17022024-07-25T02:10:36.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 782 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55993 req_id = e398a93c-9c1e-4e27-bed5-a2fcecee480e response_code = 200 uri = /vpc-routes
17032024-07-25T02:10:36.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55993 req_id = adf17edf-a4cc-4e7a-ad40-9f95f6aa4fd1 response_code = 204 uri = /vpc-routes
17042024-07-25T02:10:37.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42835
17052024-07-25T02:10:37.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42835 req_id = 1b55ed66-7152-4a35-8520-f809f24f7b67 response_code = 200 uri = /v2p
17062024-07-25T02:10:37.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62177
17072024-07-25T02:10:37.102ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
17082024-07-25T02:10:37.127ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
17092024-07-25T02:10:37.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 46263 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62177 req_id = cd172fdd-0276-4501-9947-77478a058cd2 response_code = 204 uri = /switch-ports
17102024-07-25T02:10:37.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62177 req_id = 089544a5-5440-4260-84e8-06a187705730 response_code = 200 uri = /network-bootstore-config
17112024-07-25T02:10:43.169ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 695 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = 165cba49-c800-43e1-bb1e-d9a454886437 response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
17122024-07-25T02:10:55.997ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54947
17132024-07-25T02:10:55.997ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 74 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54947 req_id = 36a5ac2e-f58a-4301-97a1-8619686d3aa4 response_code = 200 uri = /baseboard
17142024-07-25T02:11:06.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34394
17152024-07-25T02:11:06.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34394 req_id = bfcd0cef-f1c6-4d73-a415-09fdaceef9b2 response_code = 200 uri = /vpc-routes
17162024-07-25T02:11:06.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34394 req_id = cdb1eb0a-107f-4711-92ed-ca1391220fac response_code = 204 uri = /vpc-routes
17172024-07-25T02:11:06.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54138
17182024-07-25T02:11:06.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 995 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54138 req_id = 712b407c-011e-4cca-989a-c0a7bb67548a response_code = 200 uri = /vpc-routes
17192024-07-25T02:11:06.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54138 req_id = 972889b6-d904-4ac9-badb-5d48988a6fb7 response_code = 204 uri = /vpc-routes
17202024-07-25T02:11:06.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53561
17212024-07-25T02:11:06.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53561 req_id = f2ba73ab-97e8-4e00-8839-55ac0c620b4c response_code = 200 uri = /v2p
17222024-07-25T02:11:06.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57224
17232024-07-25T02:11:06.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 608 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57224 req_id = a60e93a0-7774-4d12-9103-41cc2131d2c0 response_code = 200 uri = /v2p
17242024-07-25T02:11:06.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52656
17252024-07-25T02:11:06.796ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
17262024-07-25T02:11:06.821ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
17272024-07-25T02:11:06.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 52245 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52656 req_id = 1e4b3ff4-3834-4813-9eab-1bd117af3162 response_code = 204 uri = /switch-ports
17282024-07-25T02:11:06.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48017
17292024-07-25T02:11:06.849ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
17302024-07-25T02:11:06.881ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
17312024-07-25T02:11:06.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 56479 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48017 req_id = 75375e50-9701-46b9-bce4-17c2bd83d001 response_code = 204 uri = /switch-ports
17322024-07-25T02:11:06.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52656 req_id = a4927c0c-cb05-4847-b333-115f23fd818e response_code = 200 uri = /network-bootstore-config
17332024-07-25T02:11:06.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48017 req_id = 80d9a391-15f3-4f8e-bdb6-7b67b998c42f response_code = 200 uri = /network-bootstore-config
17342024-07-25T02:11:07.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32818
17352024-07-25T02:11:07.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32818 req_id = 1aab8ff0-2a8a-4242-b5bf-77d4783938ef response_code = 200 uri = /vpc-routes
17362024-07-25T02:11:07.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32818 req_id = 1ec0ae43-ca0b-424f-9d96-882e97a95beb response_code = 204 uri = /vpc-routes
17372024-07-25T02:11:07.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33898
17382024-07-25T02:11:07.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33898 req_id = e5351371-dab1-41a5-8053-0188065fbfae response_code = 200 uri = /v2p
17392024-07-25T02:11:07.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57953
17402024-07-25T02:11:07.448ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
17412024-07-25T02:11:07.473ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
17422024-07-25T02:11:07.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 45332 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57953 req_id = f94b2e59-8eb0-4e3e-84c1-e9e005d52379 response_code = 204 uri = /switch-ports
17432024-07-25T02:11:07.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 709 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57953 req_id = bcfbc517-64ab-4698-b916-dbdc0508f89e response_code = 200 uri = /network-bootstore-config
17442024-07-25T02:11:13.169ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 594 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = f0caa945-c64d-4a60-98a0-7415b0e9d311 response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
17452024-07-25T02:11:26.032ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51629
17462024-07-25T02:11:26.032ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51629 req_id = 39b79082-0ee7-4fc6-a9e6-aa244443dbcb response_code = 200 uri = /baseboard
17472024-07-25T02:11:36.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54190
17482024-07-25T02:11:36.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 951 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54190 req_id = d289fe0c-b7dd-41d3-8742-0cbffb526f2c response_code = 200 uri = /vpc-routes
17492024-07-25T02:11:36.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54190 req_id = 4bf5a97b-efbc-4831-92ab-88938e342258 response_code = 204 uri = /vpc-routes
17502024-07-25T02:11:36.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40272
17512024-07-25T02:11:36.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40272 req_id = f9f5504d-9ca3-4868-b196-47440fb36e4a response_code = 200 uri = /v2p
17522024-07-25T02:11:36.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35328
17532024-07-25T02:11:36.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35328 req_id = 6fcbdb6f-6820-454a-bed2-f0f9d43d40b3 response_code = 200 uri = /vpc-routes
17542024-07-25T02:11:36.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56105
17552024-07-25T02:11:36.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 696 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56105 req_id = b74178e5-a5bd-4bc2-9279-ef85a660e3e1 response_code = 200 uri = /v2p
17562024-07-25T02:11:36.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35328 req_id = ca592ca4-d1b7-4083-9577-b85aeb346dd1 response_code = 204 uri = /vpc-routes
17572024-07-25T02:11:36.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61848
17582024-07-25T02:11:36.626ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
17592024-07-25T02:11:36.650ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
17602024-07-25T02:11:36.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 46862 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61848 req_id = eaf837d1-4c4d-4864-87e6-fdf05326ee88 response_code = 204 uri = /switch-ports
17612024-07-25T02:11:36.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64363
17622024-07-25T02:11:36.673ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
17632024-07-25T02:11:36.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 4281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61848 req_id = e17ef8ba-3a2c-4dfe-a81c-7a099cc7775b response_code = 200 uri = /network-bootstore-config
17642024-07-25T02:11:36.701ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
17652024-07-25T02:11:36.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 50052 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64363 req_id = 53b3dd33-5e39-4b3f-8c86-6634fcfbe532 response_code = 204 uri = /switch-ports
17662024-07-25T02:11:36.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64363 req_id = 66eb28d9-7209-4c92-a48a-9d5c0ee9e073 response_code = 200 uri = /network-bootstore-config
17672024-07-25T02:11:36.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62206
17682024-07-25T02:11:36.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62206 req_id = 46a471db-674d-4a95-a011-56264f580b45 response_code = 200 uri = /vpc-routes
17692024-07-25T02:11:36.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62206 req_id = 747ec991-429f-4597-9818-e1a418226af1 response_code = 204 uri = /vpc-routes
17702024-07-25T02:11:37.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45663
17712024-07-25T02:11:37.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 817 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45663 req_id = 6e3597fb-ddce-40f7-a8fb-5744882cbe23 response_code = 200 uri = /v2p
17722024-07-25T02:11:37.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41562
17732024-07-25T02:11:37.205ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
17742024-07-25T02:11:37.231ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
17752024-07-25T02:11:37.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 48976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41562 req_id = 90a6eaf3-65ac-48e9-add0-f9d220149123 response_code = 204 uri = /switch-ports
17762024-07-25T02:11:37.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41562 req_id = 56bdba9b-6335-4972-aa61-6016b4ed89ce response_code = 200 uri = /network-bootstore-config
17772024-07-25T02:11:43.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1013 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = 7aa8c9d1-48ec-4f2b-aac5-2d14ec308c8f response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
17782024-07-25T02:11:56.066ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62800
17792024-07-25T02:11:56.066ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62800 req_id = fc809751-8005-4c85-8e90-479a005ddf1e response_code = 200 uri = /baseboard
17802024-07-25T02:12:06.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47723
17812024-07-25T02:12:06.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1548 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47723 req_id = 02cf736c-6eed-45b3-b2ad-765188d46853 response_code = 200 uri = /vpc-routes
17822024-07-25T02:12:06.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47723 req_id = 03ef6121-6b13-4a50-bac7-4499f4b4db8e response_code = 204 uri = /vpc-routes
17832024-07-25T02:12:06.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60158
17842024-07-25T02:12:06.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60158 req_id = 43dffc6a-29f0-4ee2-8ed1-e62e987f17be response_code = 200 uri = /vpc-routes
17852024-07-25T02:12:06.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60158 req_id = 8dca9218-fd54-407f-a2f7-419c16d45c74 response_code = 204 uri = /vpc-routes
17862024-07-25T02:12:06.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52435
17872024-07-25T02:12:06.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52435 req_id = 3d9c9dd3-ff48-4d27-bae0-1075bcccae6a response_code = 200 uri = /v2p
17882024-07-25T02:12:06.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47624
17892024-07-25T02:12:06.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47624 req_id = b5f7b78f-1738-49ba-9b8e-dddd4cb3dee6 response_code = 200 uri = /v2p
17902024-07-25T02:12:06.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60382
17912024-07-25T02:12:06.852ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
17922024-07-25T02:12:06.882ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
17932024-07-25T02:12:06.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 54591 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60382 req_id = b241939a-6ec6-4c02-bdef-88fd1d9e3b7e response_code = 204 uri = /switch-ports
17942024-07-25T02:12:06.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47623
17952024-07-25T02:12:06.907ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
17962024-07-25T02:12:06.935ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
17972024-07-25T02:12:06.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 49754 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47623 req_id = 717757b5-95b6-4b9a-ad02-d17556049597 response_code = 204 uri = /switch-ports
17982024-07-25T02:12:06.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47623 req_id = 17dfdcb7-5c60-4a4d-9729-310cadfdf40e response_code = 200 uri = /network-bootstore-config
17992024-07-25T02:12:06.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1006 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60382 req_id = d72f99e7-5eff-456d-b0ea-c8b58de8bd2f response_code = 200 uri = /network-bootstore-config
18002024-07-25T02:12:07.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34226
18012024-07-25T02:12:07.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34226 req_id = a02ad8c4-59ed-4a76-bca5-a65c20830267 response_code = 200 uri = /vpc-routes
18022024-07-25T02:12:07.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34226 req_id = b5594805-6380-4d4e-bbc5-1dd8aae5a371 response_code = 204 uri = /vpc-routes
18032024-07-25T02:12:07.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64188
18042024-07-25T02:12:07.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1078 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64188 req_id = 6b4bd6da-54ce-41ba-965e-94445731d9ca response_code = 200 uri = /v2p
18052024-07-25T02:12:07.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64918
18062024-07-25T02:12:07.327ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
18072024-07-25T02:12:07.350ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
18082024-07-25T02:12:07.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 46326 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64918 req_id = 1be8cc13-9f9d-4d89-9ede-9792076f7d15 response_code = 204 uri = /switch-ports
18092024-07-25T02:12:07.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64918 req_id = 84c382e2-7b0c-4120-8faa-2958676671ea response_code = 200 uri = /network-bootstore-config
18102024-07-25T02:12:13.338ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 474 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = 56f07492-560d-44eb-beca-0feefc3bb81c response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
18112024-07-25T02:12:17.594ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18122024-07-25T02:12:26.101ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51902
18132024-07-25T02:12:26.101ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51902 req_id = 890162d4-b3f7-4f41-aa26-bebf394a9473 response_code = 200 uri = /baseboard
18142024-07-25T02:12:36.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62430
18152024-07-25T02:12:36.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 757 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62430 req_id = 52dbe8a6-10ef-473f-b47a-e1e3bb4fff5c response_code = 200 uri = /vpc-routes
18162024-07-25T02:12:36.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62430 req_id = 914900b2-e0bf-4587-99ec-2734bfde5012 response_code = 204 uri = /vpc-routes
18172024-07-25T02:12:36.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59997
18182024-07-25T02:12:36.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59997 req_id = aea7aefd-64ed-435d-8c36-38e442d4c293 response_code = 200 uri = /vpc-routes
18192024-07-25T02:12:36.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 975 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59997 req_id = 2dee1f00-3655-4fc2-922e-ee88f72391fd response_code = 204 uri = /vpc-routes
18202024-07-25T02:12:36.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45337
18212024-07-25T02:12:36.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45337 req_id = b5486ebb-5534-4fd3-9764-e49b7b8f79ad response_code = 200 uri = /v2p
18222024-07-25T02:12:36.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61923
18232024-07-25T02:12:36.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61923 req_id = 0337d210-4ea2-4c08-921a-e61fbef14cba response_code = 200 uri = /v2p
18242024-07-25T02:12:36.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44855
18252024-07-25T02:12:36.655ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
18262024-07-25T02:12:36.680ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
18272024-07-25T02:12:36.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 48606 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44855 req_id = 4876d798-479c-4a0a-be82-5e3cbd80be3b response_code = 204 uri = /switch-ports
18282024-07-25T02:12:36.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54545
18292024-07-25T02:12:36.704ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
18302024-07-25T02:12:36.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 2897 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44855 req_id = 7bfa7b50-e523-45c9-8968-065e25fc8b67 response_code = 200 uri = /network-bootstore-config
18312024-07-25T02:12:36.726ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
18322024-07-25T02:12:36.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 44012 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54545 req_id = 5b2a4614-a599-4823-a068-79aec95e7437 response_code = 204 uri = /switch-ports
18332024-07-25T02:12:36.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54545 req_id = 5adf7738-406b-40a1-989c-ad135cde97f3 response_code = 200 uri = /network-bootstore-config
18342024-07-25T02:12:37.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56960
18352024-07-25T02:12:37.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56960 req_id = e137c7d7-6919-4561-975c-a8684188aad8 response_code = 200 uri = /vpc-routes
18362024-07-25T02:12:37.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56960 req_id = 7a63a77a-333d-4648-96c0-7076966069cc response_code = 204 uri = /vpc-routes
18372024-07-25T02:12:37.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34558
18382024-07-25T02:12:37.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 603 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34558 req_id = d9095b41-5e69-4595-a4dc-4d34636d7841 response_code = 200 uri = /v2p
18392024-07-25T02:12:37.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49702
18402024-07-25T02:12:37.241ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
18412024-07-25T02:12:37.266ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
18422024-07-25T02:12:37.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 45369 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49702 req_id = a61cad0b-8f19-4385-a297-6b7d4da71733 response_code = 204 uri = /switch-ports
18432024-07-25T02:12:37.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49702 req_id = d8d3d28e-cad0-4828-bc6f-53c4634f7337 response_code = 200 uri = /network-bootstore-config
18442024-07-25T02:12:43.339ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 591 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = fb19f160-ce32-4206-a782-842d6e180b0e response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
18452024-07-25T02:12:56.134ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44081
18462024-07-25T02:12:56.134ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 91 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44081 req_id = 4a3682a9-21ae-4f1c-9014-4a272ba6e9ac response_code = 200 uri = /baseboard
18472024-07-25T02:13:06.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43995
18482024-07-25T02:13:06.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43995 req_id = aa2ab757-2cd1-4050-8cd1-d62bde609446 response_code = 200 uri = /vpc-routes
18492024-07-25T02:13:06.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43995 req_id = 536208d1-8bcb-4278-8648-5b0dd3b2c982 response_code = 204 uri = /vpc-routes
18502024-07-25T02:13:06.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44338
18512024-07-25T02:13:06.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1053 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44338 req_id = b2910c00-b69c-4d81-ad84-e609c41f4a32 response_code = 200 uri = /v2p
18522024-07-25T02:13:06.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35893
18532024-07-25T02:13:06.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35893 req_id = 9f33dde7-199a-46cd-891a-be952f6a41fd response_code = 200 uri = /vpc-routes
18542024-07-25T02:13:06.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35893 req_id = ed041b70-8bdb-4fd6-9919-1352e5d0b8ce response_code = 204 uri = /vpc-routes
18552024-07-25T02:13:06.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35997
18562024-07-25T02:13:06.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35997 req_id = 3e64011f-eb69-44eb-8508-05dfbf1e4e47 response_code = 200 uri = /v2p
18572024-07-25T02:13:06.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63676
18582024-07-25T02:13:06.720ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
18592024-07-25T02:13:06.746ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
18602024-07-25T02:13:06.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 48496 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63676 req_id = 18baf027-1c2f-4e6a-ae7c-8781464ec99a response_code = 204 uri = /switch-ports
18612024-07-25T02:13:06.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63676 req_id = 49588e4c-e09a-4f5f-97a6-fcce2514326f response_code = 200 uri = /network-bootstore-config
18622024-07-25T02:13:06.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49232
18632024-07-25T02:13:06.900ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
18642024-07-25T02:13:06.925ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
18652024-07-25T02:13:06.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 48551 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49232 req_id = 608603d5-cc31-4ee5-8691-bba3629a589c response_code = 204 uri = /switch-ports
18662024-07-25T02:13:06.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49232 req_id = 7357480d-76ee-4c5a-af6a-38c53350a7f8 response_code = 200 uri = /network-bootstore-config
18672024-07-25T02:13:07.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38376
18682024-07-25T02:13:07.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38376 req_id = 708d0b9d-2b05-4be1-8734-f951d9b2c8e1 response_code = 200 uri = /vpc-routes
18692024-07-25T02:13:07.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38376 req_id = ac565d71-e94c-46b4-b43f-0dbf8f3bc716 response_code = 204 uri = /vpc-routes
18702024-07-25T02:13:07.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35700
18712024-07-25T02:13:07.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35700 req_id = c5cb7919-6c42-48c0-80c4-6f900e7c2f22 response_code = 200 uri = /v2p
18722024-07-25T02:13:07.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41176
18732024-07-25T02:13:07.534ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
18742024-07-25T02:13:07.558ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
18752024-07-25T02:13:07.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 46216 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41176 req_id = 2fc493a4-2dbd-41e5-b229-0861a798f4c0 response_code = 204 uri = /switch-ports
18762024-07-25T02:13:07.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41176 req_id = 72718f52-feb3-4e41-bb06-4bda3f4804b7 response_code = 200 uri = /network-bootstore-config
18772024-07-25T02:13:13.340ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1055 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = aa6d18d0-1d46-47b1-aead-a617aad337e3 response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
18782024-07-25T02:13:26.168ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40250
18792024-07-25T02:13:26.168ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 66 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40250 req_id = 5fcad386-a8b4-468e-8859-70a9fa459e93 response_code = 200 uri = /baseboard
18802024-07-25T02:13:36.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45885
18812024-07-25T02:13:36.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45885 req_id = fa315157-944c-4db8-82ba-9b91820c43a0 response_code = 200 uri = /vpc-routes
18822024-07-25T02:13:36.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45885 req_id = 6d88399f-1a6f-4f11-81e4-c6edae8d1af5 response_code = 204 uri = /vpc-routes
18832024-07-25T02:13:36.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54400
18842024-07-25T02:13:36.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 21 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54400 req_id = 5f859d83-2594-43fb-971c-3d544bd515ec response_code = 200 uri = /vpc-routes
18852024-07-25T02:13:36.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54400 req_id = 11de51f5-8d44-4950-9448-c5b7d1fd72b1 response_code = 204 uri = /vpc-routes
18862024-07-25T02:13:36.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44593
18872024-07-25T02:13:36.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 850 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44593 req_id = b7aa5a77-c862-4e06-82be-9b6e404e5bf1 response_code = 200 uri = /v2p
18882024-07-25T02:13:36.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64518
18892024-07-25T02:13:36.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64518 req_id = dad97f44-f2a1-4e0b-8740-aa8a22ed1be2 response_code = 200 uri = /v2p
18902024-07-25T02:13:36.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34928
18912024-07-25T02:13:36.508ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
18922024-07-25T02:13:36.534ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
18932024-07-25T02:13:36.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 48233 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34928 req_id = ed655e4d-02dc-4927-9ec3-6692b7a04381 response_code = 204 uri = /switch-ports
18942024-07-25T02:13:36.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34928 req_id = 6cd41c8f-977a-40fd-94fb-27e572e990a1 response_code = 200 uri = /network-bootstore-config
18952024-07-25T02:13:36.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53789
18962024-07-25T02:13:36.592ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
18972024-07-25T02:13:36.617ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
18982024-07-25T02:13:36.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 46679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53789 req_id = 85bd665d-c548-42c3-b641-ccfab91a991c response_code = 204 uri = /switch-ports
18992024-07-25T02:13:36.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53789 req_id = 3d9c5664-f507-4c40-80b2-0b6d010df385 response_code = 200 uri = /network-bootstore-config
19002024-07-25T02:13:36.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53483
19012024-07-25T02:13:36.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53483 req_id = aad64565-c9af-469c-81a5-e8832a90536c response_code = 200 uri = /vpc-routes
19022024-07-25T02:13:36.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53483 req_id = 713311f8-55e5-4652-81a1-70f71f022bab response_code = 204 uri = /vpc-routes
19032024-07-25T02:13:37.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60355
19042024-07-25T02:13:37.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60355 req_id = 26268026-b267-4e71-89a1-190dddff2738 response_code = 200 uri = /v2p
19052024-07-25T02:13:37.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62291
19062024-07-25T02:13:37.205ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
19072024-07-25T02:13:37.230ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
19082024-07-25T02:13:37.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 48425 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62291 req_id = f80f43cb-2963-4731-9a71-6f59ae11975b response_code = 204 uri = /switch-ports
19092024-07-25T02:13:37.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62291 req_id = 9d592779-82db-4d4b-8e27-ebebe0416079 response_code = 200 uri = /network-bootstore-config
19102024-07-25T02:13:43.339ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 553 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = e02e46b4-b0f9-40b1-985d-a0921ccdc26a response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
19112024-07-25T02:13:56.202ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63366
19122024-07-25T02:13:56.202ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63366 req_id = de4550c2-a52b-40fe-9dd3-e16c5974ab60 response_code = 200 uri = /baseboard
19132024-07-25T02:14:06.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51058
19142024-07-25T02:14:06.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51058 req_id = b06d3fc9-9906-499f-9b9d-63989be37d03 response_code = 200 uri = /vpc-routes
19152024-07-25T02:14:06.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51058 req_id = 7b17e994-d0a2-467b-83d6-efd2917957d4 response_code = 204 uri = /vpc-routes
19162024-07-25T02:14:06.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56115
19172024-07-25T02:14:06.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56115 req_id = b39c9f48-2a8e-4dbf-a1c4-0c4532994284 response_code = 200 uri = /v2p
19182024-07-25T02:14:06.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46746
19192024-07-25T02:14:06.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46746 req_id = f28c2a52-896b-406a-8405-3aa01e880297 response_code = 200 uri = /vpc-routes
19202024-07-25T02:14:06.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46746 req_id = 8d22f20e-fb44-4d10-9af9-daa7a94c7e5a response_code = 204 uri = /vpc-routes
19212024-07-25T02:14:06.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53575
19222024-07-25T02:14:06.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53575 req_id = 6c4ca5c1-f007-4dc9-afe1-44d2d4f7f8f1 response_code = 200 uri = /v2p
19232024-07-25T02:14:06.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53934
19242024-07-25T02:14:06.825ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2660255a-6e82-49c7-ae2e-1d3c92d8bd9d, kind: Service { id: 9f058198-eda8-4c0e-b8ea-30eb0b528159 }, name: Name("external-dns-9f058198-eda8-4c0e-b8ea-30eb0b528159"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6d1a80-5286-4c9f-95df-8068ad02f390, kind: Service { id: f4b3f798-a13c-49e1-99a7-fd75c3def461 }, name: Name("external-dns-f4b3f798-a13c-49e1-99a7-fd75c3def461"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 95])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c79351b-16e9-49a1-99bb-1ac9e3bb56dd, kind: Service { id: 4cc78cbb-766f-4dce-b83d-e0ce8e85fc47 }, name: Name("nexus-4cc78cbb-766f-4dce-b83d-e0ce8e85fc47"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c7afaa5-efdb-419d-8129-1c41d624f824, kind: Service { id: 594bcd89-4b8f-4545-902d-96c524c9339d }, name: Name("nexus-594bcd89-4b8f-4545-902d-96c524c9339d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 508f9e23-8d99-43a2-aeb6-2134550fe4a5, kind: Service { id: e2911521-a3ee-44ca-b0d0-d76b758cadb2 }, name: Name("nexus-e2911521-a3ee-44ca-b0d0-d76b758cadb2"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19252024-07-25T02:14:06.825ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19262024-07-25T02:14:06.825ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19272024-07-25T02:14:06.825ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19282024-07-25T02:14:06.825ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19292024-07-25T02:14:06.825ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19302024-07-25T02:14:06.825ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
19312024-07-25T02:14:06.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53934 req_id = 4bc7b0a9-27c2-43d2-91a5-75c3c6f93845 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19322024-07-25T02:14:06.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58472
19332024-07-25T02:14:06.880ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2660255a-6e82-49c7-ae2e-1d3c92d8bd9d, kind: Service { id: 9f058198-eda8-4c0e-b8ea-30eb0b528159 }, name: Name("external-dns-9f058198-eda8-4c0e-b8ea-30eb0b528159"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6d1a80-5286-4c9f-95df-8068ad02f390, kind: Service { id: f4b3f798-a13c-49e1-99a7-fd75c3def461 }, name: Name("external-dns-f4b3f798-a13c-49e1-99a7-fd75c3def461"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 95])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c79351b-16e9-49a1-99bb-1ac9e3bb56dd, kind: Service { id: 4cc78cbb-766f-4dce-b83d-e0ce8e85fc47 }, name: Name("nexus-4cc78cbb-766f-4dce-b83d-e0ce8e85fc47"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c7afaa5-efdb-419d-8129-1c41d624f824, kind: Service { id: 594bcd89-4b8f-4545-902d-96c524c9339d }, name: Name("nexus-594bcd89-4b8f-4545-902d-96c524c9339d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 508f9e23-8d99-43a2-aeb6-2134550fe4a5, kind: Service { id: e2911521-a3ee-44ca-b0d0-d76b758cadb2 }, name: Name("nexus-e2911521-a3ee-44ca-b0d0-d76b758cadb2"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19342024-07-25T02:14:06.881ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19352024-07-25T02:14:06.881ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19362024-07-25T02:14:06.881ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19372024-07-25T02:14:06.881ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19382024-07-25T02:14:06.881ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19392024-07-25T02:14:06.881ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
19402024-07-25T02:14:06.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1408 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58472 req_id = bbc00ce5-8f6f-45cf-b8ce-09b272d98126 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19412024-07-25T02:14:06.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62659
19422024-07-25T02:14:06.881ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
19432024-07-25T02:14:06.908ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
19442024-07-25T02:14:06.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 50255 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62659 req_id = a9509e16-65b7-44cd-a566-83f71978eaea response_code = 204 uri = /switch-ports
19452024-07-25T02:14:06.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35831
19462024-07-25T02:14:06.931ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
19472024-07-25T02:14:06.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 3274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62659 req_id = 1b2bc1a2-0e0b-4715-a9d6-8127dbb3cadf response_code = 200 uri = /network-bootstore-config
19482024-07-25T02:14:06.959ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
19492024-07-25T02:14:06.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 49503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35831 req_id = e7a7070b-ec4d-4269-ba3b-ddd5782c3929 response_code = 204 uri = /switch-ports
19502024-07-25T02:14:06.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35831 req_id = 39782711-6a32-437a-b203-ddbe2f55e2d8 response_code = 200 uri = /network-bootstore-config
19512024-07-25T02:14:07.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35751
19522024-07-25T02:14:07.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35751 req_id = cba63012-53d5-46ab-abed-cbd7e3e8be6e response_code = 200 uri = /vpc-routes
19532024-07-25T02:14:07.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35751 req_id = ff7d3140-308f-4b03-a3d7-8b4004cdedf8 response_code = 204 uri = /vpc-routes
19542024-07-25T02:14:07.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35349
19552024-07-25T02:14:07.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 691 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35349 req_id = 5fdf7248-9d3e-4c50-b0e7-3b9f1b80584a response_code = 200 uri = /v2p
19562024-07-25T02:14:07.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64362
19572024-07-25T02:14:07.403ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:673 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2660255a-6e82-49c7-ae2e-1d3c92d8bd9d, kind: Service { id: 9f058198-eda8-4c0e-b8ea-30eb0b528159 }, name: Name("external-dns-9f058198-eda8-4c0e-b8ea-30eb0b528159"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6d1a80-5286-4c9f-95df-8068ad02f390, kind: Service { id: f4b3f798-a13c-49e1-99a7-fd75c3def461 }, name: Name("external-dns-f4b3f798-a13c-49e1-99a7-fd75c3def461"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 95])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c79351b-16e9-49a1-99bb-1ac9e3bb56dd, kind: Service { id: 4cc78cbb-766f-4dce-b83d-e0ce8e85fc47 }, name: Name("nexus-4cc78cbb-766f-4dce-b83d-e0ce8e85fc47"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3c7afaa5-efdb-419d-8129-1c41d624f824, kind: Service { id: 594bcd89-4b8f-4545-902d-96c524c9339d }, name: Name("nexus-594bcd89-4b8f-4545-902d-96c524c9339d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 508f9e23-8d99-43a2-aeb6-2134550fe4a5, kind: Service { id: e2911521-a3ee-44ca-b0d0-d76b758cadb2 }, name: Name("nexus-e2911521-a3ee-44ca-b0d0-d76b758cadb2"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19582024-07-25T02:14:07.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19592024-07-25T02:14:07.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19602024-07-25T02:14:07.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19612024-07-25T02:14:07.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19622024-07-25T02:14:07.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19632024-07-25T02:14:07.403ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:692 port = "opte0" rules = []
19642024-07-25T02:14:07.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64362 req_id = 2d5ceb20-17f7-471f-8422-303a5947f925 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19652024-07-25T02:14:07.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35754
19662024-07-25T02:14:07.513ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
19672024-07-25T02:14:07.538ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
19682024-07-25T02:14:07.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 48128 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35754 req_id = 6190260e-48e9-41dd-ab1b-6abfa7ab7bc1 response_code = 204 uri = /switch-ports
19692024-07-25T02:14:07.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 650 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35754 req_id = c6f241a0-3c81-40da-9a03-5d44adb60d9f response_code = 200 uri = /network-bootstore-config
19702024-07-25T02:14:13.340ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 862 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = a5531223-7c63-443a-b136-1dd7f0a6e1b4 response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
19712024-07-25T02:14:26.235ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48215
19722024-07-25T02:14:26.235ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48215 req_id = b9a24620-265b-407a-9dc1-23569950eca5 response_code = 200 uri = /baseboard
19732024-07-25T02:14:36.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50253
19742024-07-25T02:14:36.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50253 req_id = f643f117-1e6c-4274-b8f1-83cbf242fa46 response_code = 200 uri = /vpc-routes
19752024-07-25T02:14:36.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 900 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50253 req_id = 60dc6795-2f57-423f-adcf-dd36d818c2d5 response_code = 204 uri = /vpc-routes
19762024-07-25T02:14:36.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35082
19772024-07-25T02:14:36.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35082 req_id = fc403858-a2cd-479b-8ac7-e302a4c6265f response_code = 200 uri = /v2p
19782024-07-25T02:14:36.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56527
19792024-07-25T02:14:36.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56527 req_id = 49f7ed77-a43f-4eea-89df-937f6d5096c3 response_code = 200 uri = /vpc-routes
19802024-07-25T02:14:36.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56527 req_id = cff7a52c-45b0-4228-ab8b-4b58cfdf4f1a response_code = 204 uri = /vpc-routes
19812024-07-25T02:14:36.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38406
19822024-07-25T02:14:36.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 902 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38406 req_id = 5ecb649c-7a8d-424b-8ffe-7c4560dd4555 response_code = 200 uri = /v2p
19832024-07-25T02:14:36.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36968
19842024-07-25T02:14:36.572ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
19852024-07-25T02:14:36.597ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
19862024-07-25T02:14:36.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 48362 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36968 req_id = d4a1b2f2-bd90-4951-b4d8-528d44c9cf3c response_code = 204 uri = /switch-ports
19872024-07-25T02:14:36.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54670
19882024-07-25T02:14:36.621ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
19892024-07-25T02:14:36.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 3351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36968 req_id = 73ff8468-8292-41e1-a18a-8c5ef0ebfa5b response_code = 200 uri = /network-bootstore-config
19902024-07-25T02:14:36.644ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
19912024-07-25T02:14:36.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 43745 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54670 req_id = aa9bd908-c6ed-4b28-89dc-994111b6ba71 response_code = 204 uri = /switch-ports
19922024-07-25T02:14:36.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 807 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54670 req_id = 7e8b19f0-76ea-4d2d-8895-aeeacba95504 response_code = 200 uri = /network-bootstore-config
19932024-07-25T02:14:37.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45491
19942024-07-25T02:14:37.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45491 req_id = bb0e664f-aab9-4877-8023-5a862b1ade6c response_code = 200 uri = /vpc-routes
19952024-07-25T02:14:37.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45491 req_id = 3a745b8c-d9ac-4b88-9927-95d3c8887f99 response_code = 204 uri = /vpc-routes
19962024-07-25T02:14:37.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40636
19972024-07-25T02:14:37.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 850 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40636 req_id = a87f930b-3f70-429e-843f-d0c9317b355f response_code = 200 uri = /v2p
19982024-07-25T02:14:37.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56637
19992024-07-25T02:14:37.246ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
20002024-07-25T02:14:37.270ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
20012024-07-25T02:14:37.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 45977 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56637 req_id = 5f347141-f0d9-467d-8eba-47e85b6d96e4 response_code = 204 uri = /switch-ports
20022024-07-25T02:14:37.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56637 req_id = 8e8457ba-2718-440e-8bae-e2f9e29b2479 response_code = 200 uri = /network-bootstore-config
20032024-07-25T02:14:43.421ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 454 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = 11d27241-b271-48e6-9834-10a885568695 response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
20042024-07-25T02:14:56.269ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45764
20052024-07-25T02:14:56.269ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45764 req_id = 01049141-2f38-43df-af84-d470ccf395fc response_code = 200 uri = /baseboard
20062024-07-25T02:15:06.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39926
20072024-07-25T02:15:06.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1099 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39926 req_id = 428b1bdc-244b-42d7-ab2e-366b9f5d11d7 response_code = 200 uri = /v2p
20082024-07-25T02:15:06.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43234
20092024-07-25T02:15:06.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43234 req_id = 0c9284a8-1c0d-48d0-a84c-79c529da1085 response_code = 200 uri = /vpc-routes
20102024-07-25T02:15:06.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43234 req_id = 3de13c48-a09b-4972-a744-3171ca051f91 response_code = 204 uri = /vpc-routes
20112024-07-25T02:15:06.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42275
20122024-07-25T02:15:06.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 774 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42275 req_id = cbe2894a-d837-4e10-a1fa-b8ccd1c85660 response_code = 200 uri = /vpc-routes
20132024-07-25T02:15:06.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42275 req_id = 4d81ab08-935b-43e7-9d8b-25f3e7de2239 response_code = 204 uri = /vpc-routes
20142024-07-25T02:15:06.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59546
20152024-07-25T02:15:06.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 860 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59546 req_id = d002484b-051a-456f-adb8-1364afc19ebd response_code = 200 uri = /v2p
20162024-07-25T02:15:06.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49238
20172024-07-25T02:15:06.756ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
20182024-07-25T02:15:06.780ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
20192024-07-25T02:15:06.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 45441 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49238 req_id = f4c36633-d6c8-45d4-a1eb-694c0d2e437f response_code = 204 uri = /switch-ports
20202024-07-25T02:15:06.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 797 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49238 req_id = 6ca6ddc9-ab54-4681-86e4-edf873d47314 response_code = 200 uri = /network-bootstore-config
20212024-07-25T02:15:06.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41945
20222024-07-25T02:15:06.942ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
20232024-07-25T02:15:06.968ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
20242024-07-25T02:15:06.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 47587 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41945 req_id = 8921c28c-a684-4b88-b43d-87573048d9a6 response_code = 204 uri = /switch-ports
20252024-07-25T02:15:06.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41945 req_id = b46f7438-5b29-42ae-b7b2-ad06625daf8e response_code = 200 uri = /network-bootstore-config
20262024-07-25T02:15:07.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63022
20272024-07-25T02:15:07.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63022 req_id = a09efb72-7c9d-4b42-901c-135e8d06dba6 response_code = 200 uri = /vpc-routes
20282024-07-25T02:15:07.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 757 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63022 req_id = af5aa631-077d-47ea-ab28-9a31828cb058 response_code = 204 uri = /vpc-routes
20292024-07-25T02:15:07.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37446
20302024-07-25T02:15:07.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 791 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37446 req_id = fb0c8698-b151-435f-b3ba-cb196506a237 response_code = 200 uri = /v2p
20312024-07-25T02:15:07.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62479
20322024-07-25T02:15:07.465ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
20332024-07-25T02:15:07.490ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
20342024-07-25T02:15:07.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 48405 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62479 req_id = 01ff2842-d978-49e2-bc19-f086463b5271 response_code = 204 uri = /switch-ports
20352024-07-25T02:15:07.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62479 req_id = 594ca02a-c72d-491c-9b1f-8cffbf9c066e response_code = 200 uri = /network-bootstore-config
20362024-07-25T02:15:13.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1108 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = 441c5309-c7d8-4b04-84ae-bab69232b6b6 response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
20372024-07-25T02:15:26.303ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62242
20382024-07-25T02:15:26.303ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62242 req_id = 1a6ace50-3912-4551-b1c0-c3845f5b5e81 response_code = 200 uri = /baseboard
20392024-07-25T02:15:32.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65056
20402024-07-25T02:15:32.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65056 req_id = 70d4ec5e-14e9-4b6a-8ed0-d341b54f5627 response_code = 200 uri = /v2p
20412024-07-25T02:15:32.782ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:780 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 249, 32, 19])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6442899) }
20422024-07-25T02:15:32.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65056 req_id = 71cf4865-4514-467a-9597-66ca35f28aa2 response_code = 204 uri = /v2p
20432024-07-25T02:15:32.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34865
20442024-07-25T02:15:32.889ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:577 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 67cfe838-1a56-4c2a-9558-bee3072a6a18, kind: Instance { id: d00caa07-a2d4-4e74-8a91-7e685ede33ec }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 32, 19])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6442899), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cfe838-1a56-4c2a-9558-bee3072a6a18, kind: Instance { id: d00caa07-a2d4-4e74-8a91-7e685ede33ec }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 32, 19])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6442899), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cfe838-1a56-4c2a-9558-bee3072a6a18, kind: Instance { id: d00caa07-a2d4-4e74-8a91-7e685ede33ec }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 32, 19])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6442899), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6442899))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cfe838-1a56-4c2a-9558-bee3072a6a18, kind: Instance { id: d00caa07-a2d4-4e74-8a91-7e685ede33ec }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 32, 19])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6442899), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-9d9638376a6", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 9d36bd6b-049a-4044-af2e-2b4a9f6156af, read_only_parent: Some(Volume { block_size: 512, id: 09e4fd90-f466-4685-8865-52ff771e4ee4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 4d373c64-7150-44c1-aee7-1a6f20a2f49e, key: Some("cBDpHO/gDlKyc1KI96RRe7rfH/JIUmx1DBCtElnJV2c="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9d36bd6b-049a-4044-af2e-2b4a9f6156af, key: Some("h0a9KEdV6H2BBUaqDQw3ktJHZI5JrumeKMc61t4Yu0M="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::13]:19003", "[fd00:1122:3344:101::18]:19001"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAABU8BH5WPlYAADwEflYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAVPAR+Vj5WAAA8BH5WAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJkMDBjYWEwNy1hMmQ0LTRlNzQtOGE5MS03ZTY4NWVkZTMzZWMiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQnZzWm11Z3RoTXVWMTFnMW1GOC9hNTdjNjV0RW10cEh3K3VlanovZFRLOSJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec instance_runtime = InstanceRuntimeState { propolis_id: Some(9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-07-25T02:15:32.512754156Z } metadata = InstanceMetadata { silo_id: 09e40161-eadb-4729-901e-268f37583484, project_id: 4aac722a-ba87-482b-8a2a-4826683c460a } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 9fa36e4a-64cd-47e4-8ad2-d25d6f729309 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-07-25T02:15:32.450908Z }
20452024-07-25T02:15:32.889ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:611 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec (instance)
20462024-07-25T02:15:32.889ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:951 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec propolis_id = 9fa36e4a-64cd-47e4-8ad2-d25d6f729309 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 67cfe838-1a56-4c2a-9558-bee3072a6a18, kind: Instance { id: d00caa07-a2d4-4e74-8a91-7e685ede33ec }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 32, 19])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6442899), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cfe838-1a56-4c2a-9558-bee3072a6a18, kind: Instance { id: d00caa07-a2d4-4e74-8a91-7e685ede33ec }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 32, 19])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6442899), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cfe838-1a56-4c2a-9558-bee3072a6a18, kind: Instance { id: d00caa07-a2d4-4e74-8a91-7e685ede33ec }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 32, 19])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6442899), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6442899))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cfe838-1a56-4c2a-9558-bee3072a6a18, kind: Instance { id: d00caa07-a2d4-4e74-8a91-7e685ede33ec }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 32, 19])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6442899), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-9d9638376a6", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 9d36bd6b-049a-4044-af2e-2b4a9f6156af, read_only_parent: Some(Volume { block_size: 512, id: 09e4fd90-f466-4685-8865-52ff771e4ee4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 4d373c64-7150-44c1-aee7-1a6f20a2f49e, key: Some("cBDpHO/gDlKyc1KI96RRe7rfH/JIUmx1DBCtElnJV2c="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9d36bd6b-049a-4044-af2e-2b4a9f6156af, key: Some("h0a9KEdV6H2BBUaqDQw3ktJHZI5JrumeKMc61t4Yu0M="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::13]:19003", "[fd00:1122:3344:101::18]:19001"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAABU8BH5WPlYAADwEflYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAVPAR+Vj5WAAA8BH5WAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJkMDBjYWEwNy1hMmQ0LTRlNzQtOGE5MS03ZTY4NWVkZTMzZWMiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQnZzWm11Z3RoTXVWMTFnMW1GOC9hNTdjNjV0RW10cEh3K3VlanovZFRLOSJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-07-25T02:15:32.512754156Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-07-25T02:15:32.450908Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
20472024-07-25T02:15:32.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 9796 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34865 req_id = 63f6c490-4059-4f1c-8e12-bdbd5ba2b2d0 response_code = 200 uri = /instances/d00caa07-a2d4-4e74-8a91-7e685ede33ec
20482024-07-25T02:15:33.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44173
20492024-07-25T02:15:33.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1438 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44173 req_id = 4c4e300f-78ae-46cf-9a8a-b0f9d5b8fea0 response_code = 200 uri = /instances/d00caa07-a2d4-4e74-8a91-7e685ede33ec/state
20502024-07-25T02:15:33.030ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:426 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 249, 32, 19]), slot: 0, vni: Vni { inner: 6442899 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
20512024-07-25T02:15:33.030ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
20522024-07-25T02:15:33.066ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309 file = illumos-utils/src/zone.rs:316 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
20532024-07-25T02:15:33.089ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309 file = illumos-utils/src/zone.rs:354 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
20542024-07-25T02:15:34.393ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='[fd00:1122:3344:101::a]:12221'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
20552024-07-25T02:15:34.393ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309 zone file = illumos-utils/src/running_zone.rs:465 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec zone = oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309
20562024-07-25T02:15:34.572ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 39.3759ms file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec zone = oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309
20572024-07-25T02:15:34.619ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 149.325562ms file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec zone = oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309
20582024-07-25T02:15:34.793ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 246.51567ms file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec zone = oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309
20592024-07-25T02:15:35.053ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 200.83379ms file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec zone = oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309
20602024-07-25T02:15:35.271ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 647.299174ms file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec zone = oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309
20612024-07-25T02:15:35.931ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 747.475954ms file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec zone = oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309
20622024-07-25T02:15:36.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37878
20632024-07-25T02:15:36.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37878 req_id = abc4251c-ca99-41a6-aa54-0cd9d03a6c00 response_code = 200 uri = /vpc-routes
20642024-07-25T02:15:36.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64772
20652024-07-25T02:15:36.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37878 req_id = 18ab8df2-415c-471f-b2d6-db8e3a60206f response_code = 204 uri = /vpc-routes
20662024-07-25T02:15:36.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34851
20672024-07-25T02:15:36.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34851 req_id = afdfded8-bae7-483f-a0e7-726b9ef52824 response_code = 200 uri = /v2p
20682024-07-25T02:15:36.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39164
20692024-07-25T02:15:36.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39164 req_id = dde506ca-241d-456f-8cd8-7ecba7833ddd response_code = 200 uri = /vpc-routes
20702024-07-25T02:15:36.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39164 req_id = 41a9dbef-ffe0-4ace-a0e0-53eb396ed643 response_code = 204 uri = /vpc-routes
20712024-07-25T02:15:36.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53055
20722024-07-25T02:15:36.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38827
20732024-07-25T02:15:36.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 863 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38827 req_id = d84527b5-2a5b-44de-8df8-52bed6aa2bee response_code = 200 uri = /v2p
20742024-07-25T02:15:36.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53705
20752024-07-25T02:15:36.592ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
20762024-07-25T02:15:36.617ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
20772024-07-25T02:15:36.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 49328 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53705 req_id = f0b07653-d9ff-4d28-b07a-a53f4ea47330 response_code = 204 uri = /switch-ports
20782024-07-25T02:15:36.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53705 req_id = 1c65fc6b-253c-47c5-8676-c856674a211a response_code = 200 uri = /network-bootstore-config
20792024-07-25T02:15:36.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36727
20802024-07-25T02:15:36.666ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
20812024-07-25T02:15:36.691ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
20822024-07-25T02:15:36.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 48356 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36727 req_id = c2537973-cc07-4aba-b954-e48c335547c6 response_code = 204 uri = /switch-ports
20832024-07-25T02:15:36.722ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 1.392629477s file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec zone = oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309
20842024-07-25T02:15:36.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 715 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36727 req_id = 91f8a967-7f85-4a6a-8eb0-de9c437d67af response_code = 200 uri = /network-bootstore-config
20852024-07-25T02:15:37.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59844
20862024-07-25T02:15:37.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62123
20872024-07-25T02:15:37.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62123 req_id = a980e5eb-ff8a-4889-9c4d-cad3fb5cec47 response_code = 200 uri = /vpc-routes
20882024-07-25T02:15:37.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62123 req_id = 38dbf045-be0d-4c3d-b20a-974e1250de9b response_code = 204 uri = /vpc-routes
20892024-07-25T02:15:37.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63546
20902024-07-25T02:15:37.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 758 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63546 req_id = 9a111ba8-9713-4c4c-93d3-c689aa4357ff response_code = 200 uri = /v2p
20912024-07-25T02:15:37.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33625
20922024-07-25T02:15:37.154ZINFOSledAgent (ServiceManager): Setting up uplinkd service file = sled-agent/src/services.rs:3824
20932024-07-25T02:15:37.178ZINFOSledAgent (ServiceManager): configuring port: HostPortConfig { port: "qsfp0", addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }] } file = sled-agent/src/services.rs:3835
20942024-07-25T02:15:37.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 45605 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33625 req_id = 99469c21-e211-4f7e-8323-3ead3a974be4 response_code = 204 uri = /switch-ports
20952024-07-25T02:15:37.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33625 req_id = ca35ae20-d7a1-410d-a254-3603a2d5e833 response_code = 200 uri = /network-bootstore-config
20962024-07-25T02:15:38.125ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 918.138529ms file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec zone = oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309
20972024-07-25T02:15:39.055ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 918.675543ms file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec zone = oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309
20982024-07-25T02:15:40.002ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309 file = sled-agent/src/instance.rs:1460 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
20992024-07-25T02:15:40.011ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 49.807004ms file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21002024-07-25T02:15:40.071ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 113.811486ms file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21012024-07-25T02:15:40.194ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309") failed: Property not found. retry in 216.167868ms file = illumos-utils/src/svc.rs:36 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21022024-07-25T02:15:40.420ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1469 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21032024-07-25T02:15:40.456ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1483 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21042024-07-25T02:15:40.457ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAABU8BH5WPlYAADwEflYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAVPAR+Vj5WAAA8BH5WAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJkMDBjYWEwNy1hMmQ0LTRlNzQtOGE5MS03ZTY4NWVkZTMzZWMiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQnZzWm11Z3RoTXVWMTFnMW1GOC9hNTdjNjV0RW10cEh3K3VlanovZFRLOSJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-9d9638376a6", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 9d36bd6b-049a-4044-af2e-2b4a9f6156af, read_only_parent: Some(Volume { block_size: 512, id: 09e4fd90-f466-4685-8865-52ff771e4ee4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 4d373c64-7150-44c1-aee7-1a6f20a2f49e, key: Some("cBDpHO/gDlKyc1KI96RRe7rfH/JIUmx1DBCtElnJV2c="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9d36bd6b-049a-4044-af2e-2b4a9f6156af, key: Some("h0a9KEdV6H2BBUaqDQw3ktJHZI5JrumeKMc61t4Yu0M="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::13]:19003", "[fd00:1122:3344:101::18]:19001"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "opte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: d00caa07-a2d4-4e74-8a91-7e685ede33ec, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 4aac722a-ba87-482b-8a2a-4826683c460a, silo_id: 09e40161-eadb-4729-901e-268f37583484 }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:698 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21052024-07-25T02:15:40.633ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:700 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21062024-07-25T02:15:40.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 4212205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64772 req_id = 584b7e68-1838-4ec4-9670-1490a4637d74 response_code = 200 uri = /instances/d00caa07-a2d4-4e74-8a91-7e685ede33ec/state
21072024-07-25T02:15:40.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 4080730 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53055 req_id = 67799d93-920f-4771-8837-564f61e9cfbc response_code = 200 uri = /instances/d00caa07-a2d4-4e74-8a91-7e685ede33ec/state
21082024-07-25T02:15:40.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 3625898 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59844 req_id = 6b6d26b8-f2af-4fb8-9db9-e195274d78f2 response_code = 200 uri = /instances/d00caa07-a2d4-4e74-8a91-7e685ede33ec/state
21092024-07-25T02:15:40.634ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-07-25T02:15:40.633900953Z } file = sled-agent/src/instance.rs:584 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21102024-07-25T02:15:40.634ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:606 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec new_instance_state = InstanceRuntimeState { propolis_id: Some(9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-07-25T02:15:32.512754156Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-07-25T02:15:40.633900953Z } propolis_id = 9fa36e4a-64cd-47e4-8ad2-d25d6f729309
21112024-07-25T02:15:40.634ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:503 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-07-25T02:15:32.512754156Z }, propolis_id: 9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis), vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-07-25T02:15:40.633900953Z }, migration_state: None }
21122024-07-25T02:15:40.707ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-07-25T02:15:40.707304194Z } file = sled-agent/src/instance.rs:584 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21132024-07-25T02:15:40.707ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:606 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec new_instance_state = InstanceRuntimeState { propolis_id: Some(9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-07-25T02:15:32.512754156Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-07-25T02:15:40.707304194Z } propolis_id = 9fa36e4a-64cd-47e4-8ad2-d25d6f729309
21142024-07-25T02:15:40.707ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:503 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-07-25T02:15:32.512754156Z }, propolis_id: 9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis), vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-07-25T02:15:40.707304194Z }, migration_state: None }
21152024-07-25T02:15:40.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57806
21162024-07-25T02:15:40.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57806 req_id = 0c8bcf05-5f55-4940-bfc1-619ea18f09e0 response_code = 200 uri = /vpc-routes
21172024-07-25T02:15:40.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57806 req_id = 16168f50-e3c7-4d4a-b439-88da395065e0 response_code = 204 uri = /vpc-routes
21182024-07-25T02:15:40.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48845
21192024-07-25T02:15:40.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48845 req_id = a2a89865-c923-4279-ad52-dedffc1ce5b0 response_code = 200 uri = /vpc-routes
21202024-07-25T02:15:40.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 622 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48845 req_id = 87d2ccd7-e842-44e5-b513-c38ed5079d1d response_code = 204 uri = /vpc-routes
21212024-07-25T02:15:43.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1085 local_addr = [fd00:1122:3344:101::1]:40117 method = GET remote_addr = [fd00:1122:3344:101::d]:32985 req_id = 71115dfc-1acb-480c-a470-8ad80cb5a49e response_code = 200 sled_id = 95f9e969-8f6f-4c75-9a0a-2e70695a1940 uri = /95f9e969-8f6f-4c75-9a0a-2e70695a1940
21222024-07-25T02:15:50.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46608
21232024-07-25T02:15:50.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 663 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46608 req_id = 3482637b-864a-46c1-b8f8-3d0e29359421 response_code = 200 uri = /instances/d00caa07-a2d4-4e74-8a91-7e685ede33ec/state
21242024-07-25T02:15:50.208ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-07-25T02:15:50.208090946Z } file = sled-agent/src/instance.rs:584 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21252024-07-25T02:15:50.208ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:606 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec new_instance_state = InstanceRuntimeState { propolis_id: Some(9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-07-25T02:15:32.512754156Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-07-25T02:15:50.208090946Z } propolis_id = 9fa36e4a-64cd-47e4-8ad2-d25d6f729309
21262024-07-25T02:15:50.208ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:503 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-07-25T02:15:32.512754156Z }, propolis_id: 9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis), vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-07-25T02:15:50.208090946Z }, migration_state: None }
21272024-07-25T02:15:50.272ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-07-25T02:15:50.272721202Z } file = sled-agent/src/instance.rs:584 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21282024-07-25T02:15:50.272ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:606 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-07-25T02:15:50.272721202Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-07-25T02:15:50.272721202Z } propolis_id = 9fa36e4a-64cd-47e4-8ad2-d25d6f729309
21292024-07-25T02:15:50.272ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:621 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21302024-07-25T02:15:50.272ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
21312024-07-25T02:15:50.273ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:405
21322024-07-25T02:15:50.273ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/4d1a356e-07b8-4b75-8563-ff44a79058b8/debug/bundle/zone", "/pool/int/ab7dfa10-b7f1-4bd3-8ed6-b7984da705b7/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/553fca36-adc1-4511-ade0-15a4f26d9fb9/crypt/debug", "/pool/ext/e6466883-5708-491f-861b-b8c70eb06724/crypt/debug", "/pool/ext/ef02fb81-56c7-4030-b314-3b86902902ba/crypt/debug", "/pool/ext/07a306b8-24ae-4dbc-9694-d9d608dbd480/crypt/debug", "/pool/ext/38b79612-f102-46a4-a399-b1bc12efc31a/crypt/debug", "/pool/ext/86b20be7-f0a0-4768-ad5c-f79c894a12e5/crypt/debug", "/pool/ext/62718cfa-f65c-449a-866d-96573f2e371b/crypt/debug", "/pool/ext/8bf94d57-ddf0-47ad-9696-adda8a5ae3ee/crypt/debug", "/pool/ext/d6b0bc68-da4e-43d7-b225-9edbd58635b0/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:445 zone_name = oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309
21332024-07-25T02:15:50.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39601
21342024-07-25T02:15:50.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 831 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39601 req_id = cc4b724d-9a1b-4698-abab-028bc1d810b2 response_code = 200 uri = /vpc-routes
21352024-07-25T02:15:50.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39601 req_id = d988e7b2-b096-44b3-a0a7-afd2c1b04b34 response_code = 204 uri = /vpc-routes
21362024-07-25T02:15:50.898ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1246 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309", bundle_id: 751add9a-5186-4507-8a57-8e6451b5639e }, time_created: 2024-07-25T02:15:50.273743168Z, version: 0, cause: TerminatedInstance }
21372024-07-25T02:15:50.898ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_9fa36e4a-64cd-47e4-8ad2-d25d6f729309 file = sled-agent/src/instance.rs:793 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21382024-07-25T02:15:52.616ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:270 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21392024-07-25T02:15:52.634ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:906 id = RouterId { vni: Vni(6442899), kind: System }
21402024-07-25T02:15:52.634ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:906 id = RouterId { vni: Vni(6442899), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
21412024-07-25T02:15:52.634ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:503 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-07-25T02:15:50.272721202Z }, propolis_id: 9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-07-25T02:15:52.634681912Z }, migration_state: None }
21422024-07-25T02:15:52.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56585
21432024-07-25T02:15:52.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56585 req_id = d2fc4522-00db-4e06-8571-8f4b4dc152aa response_code = 200 uri = /v2p
21442024-07-25T02:15:52.729ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:780 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 249, 32, 19])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6442899) }
21452024-07-25T02:15:52.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 839 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56585 req_id = b52f172a-1f5b-462f-97d4-023501ed2efb response_code = 204 uri = /v2p
21462024-07-25T02:15:52.931ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:503 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-07-25T02:15:50.272721202Z }, propolis_id: 9fa36e4a-64cd-47e4-8ad2-d25d6f729309 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-07-25T02:15:52.634681912Z }, migration_state: None }
21472024-07-25T02:15:52.935ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:736 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21482024-07-25T02:15:52.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64346
21492024-07-25T02:15:52.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64346 req_id = c516f865-d623-4b76-aa6e-14378b974298 response_code = 200 uri = /vpc-routes
21502024-07-25T02:15:52.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64346 req_id = 3d3ea4fb-b5dc-4bab-a9d3-ee1895b81c7a response_code = 204 uri = /vpc-routes
21512024-07-25T02:15:53.005ZERROSledAgent (InstanceManager): Failed to publish state to Nexus, will not retry: Notification(Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d0a90c3b-f040-41df-8b77-04a5f9df9618", "content-length": "177", "date": "Thu, 25 Jul 2024 02:15:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: instance with id \"d00caa07-a2d4-4e74-8a91-7e685ede33ec\"", request_id: "d0a90c3b-f040-41df-8b77-04a5f9df9618" }) file = sled-agent/src/instance.rs:570 instance_id = d00caa07-a2d4-4e74-8a91-7e685ede33ec
21522024-07-25T02:15:53.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62850
21532024-07-25T02:15:53.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 1748 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62850 req_id = 49dc10ea-73ba-44e3-86c8-818079ff4119 response_code = 200 uri = /v2p
21542024-07-25T02:15:53.086ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:820 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 249, 32, 19])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6442899) }
21552024-07-25T02:15:53.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:62850 req_id = be368ccf-09ee-41d5-b4f4-eeb4693fc3dc response_code = 204 uri = /v2p
21562024-07-25T02:15:53.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54203
21572024-07-25T02:15:53.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 749 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54203 req_id = d44afe3d-33a7-4a2e-a0b5-39e5f2020643 response_code = 200 uri = /vpc-routes
21582024-07-25T02:15:53.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/7b594d0/dropshot/src/server.rs:914 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54203 req_id = 6d1ee89f-1741-4c12-b2e2-1be16364831c response_code = 204 uri = /vpc-routes