Max level shown:
1 [ Sep 5 00:40:00 Enabled. ]
2 [ Sep 5 00:40:00 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Sep 5 00:40:00 Method "start" exited with status 0. ]
4 [ Sep 5 00:40:00 Rereading configuration. ]
5 [ Sep 5 00:40:00 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-09-05T00:40:00.318ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-09-05T00:40:00.318ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-09-05T00:40:00.370ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-09-05T00:40:00.370ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-09-05T00:40:00.484ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-09-05T00:40:00.493ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-09-05T00:40:00.501ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-09-05T00:40:01.107ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-09-05T00:40:01.247ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-09-05T00:40:01.247ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-09-05T00:40:01.247ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-09-05T00:40:01.247ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-09-05T00:40:01.247ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:716
202024-09-05T00:40:01.247ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-09-05T00:40:01.250ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:623
222024-09-05T00:40:01.250ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:765
232024-09-05T00:40:01.250ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-09-05T00:40:01.250ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:824
252024-09-05T00:40:01.250ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-09-05T00:40:01.250ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-09-05T00:40:01.250ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
282024-09-05T00:40:01.250ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-09-05T00:40:01.250ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-09-05T00:40:01.261ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:360
312024-09-05T00:40:01.261ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool)
322024-09-05T00:40:01.357ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal }
332024-09-05T00:40:01.762ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
342024-09-05T00:40:01.762ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-09-05T00:40:01.762ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-09-05T00:40:01.762ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-09-05T00:40:01.762ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
382024-09-05T00:40:01.762ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-09-05T00:40:01.762ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-09-05T00:40:01.771ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:360
412024-09-05T00:40:01.771ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool)
422024-09-05T00:40:01.860ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal }
432024-09-05T00:40:02.269ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-09-05T00:40:02.269ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-09-05T00:40:02.269ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
482024-09-05T00:40:02.269ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-09-05T00:40:02.269ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-09-05T00:40:02.269ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-09-05T00:40:02.269ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
522024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532024-09-05T00:40:02.269ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
542024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-09-05T00:40:02.269ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-09-05T00:40:02.269ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-09-05T00:40:02.269ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
582024-09-05T00:40:02.269ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-09-05T00:40:02.269ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-09-05T00:40:02.269ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-09-05T00:40:02.269ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
662024-09-05T00:40:02.269ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-09-05T00:40:02.269ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-09-05T00:40:02.269ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-09-05T00:40:02.269ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
722024-09-05T00:40:02.269ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-09-05T00:40:02.269ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-09-05T00:40:02.269ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-09-05T00:40:02.269ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
772024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
782024-09-05T00:40:02.269ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-09-05T00:40:02.269ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-09-05T00:40:02.269ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-09-05T00:40:02.269ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
842024-09-05T00:40:02.269ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-09-05T00:40:02.269ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-09-05T00:40:02.269ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882024-09-05T00:40:02.269ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892024-09-05T00:40:02.269ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
902024-09-05T00:40:02.269ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-09-05T00:40:02.269ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-09-05T00:40:02.270ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
932024-09-05T00:40:02.270ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-09-05T00:40:02.270ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-09-05T00:40:02.270ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
962024-09-05T00:40:02.270ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
972024-09-05T00:40:02.270ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
982024-09-05T00:40:02.270ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-09-05T00:40:02.270ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1002024-09-05T00:40:02.270ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-09-05T00:40:02.270ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-09-05T00:40:02.270ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-09-05T00:40:02.270ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-09-05T00:40:02.270ZINFOSledAgent (bootstore): No ledger in /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-09-05T00:40:02.270ZINFOSledAgent (bootstore): No ledger in /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-09-05T00:40:02.270ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-09-05T00:40:02.270ZINFOSledAgent (bootstore): No ledger in /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-09-05T00:40:02.270ZINFOSledAgent (bootstore): No ledger in /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-09-05T00:40:02.270ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-09-05T00:40:02.270ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-09-05T00:40:02.270ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-09-05T00:40:02.280ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:730
1132024-09-05T00:40:02.280ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3864, tv_nsec: 456702012 } time_to_next_cleanup = 599.999931269s
1142024-09-05T00:40:02.280ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3842
1152024-09-05T00:40:02.280ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1162024-09-05T00:40:02.280ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-09-05T00:40:02.280ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-09-05T00:40:02.283ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-09-05T00:40:02.283ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-09-05T00:40:02.284ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, local_pref: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1053
1212024-09-05T00:40:02.284ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
1222024-09-05T00:40:02.284ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1232024-09-05T00:40:02.284ZINFOSledAgent (RSS): No ledger in /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-09-05T00:40:02.284ZINFOSledAgent (RSS): No ledger in /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-09-05T00:40:02.284ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1113
1262024-09-05T00:40:02.284ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1272024-09-05T00:40:02.284ZINFOSledAgent (RSS): No ledger in /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-09-05T00:40:02.284ZINFOSledAgent (RSS): No ledger in /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-09-05T00:40:02.284ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1154
1302024-09-05T00:40:02.284ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:155
1312024-09-05T00:40:02.284ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:128
1322024-09-05T00:40:02.284ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1332024-09-05T00:40:02.284ZINFOSledAgent (RSS): Writing ledger to /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-09-05T00:40:02.284ZINFOSledAgent (RSS): Writing ledger to /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-09-05T00:40:02.284ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: a014d257-275c-449e-a4f4-aef00eab141c, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, local_pref: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:175
1362024-09-05T00:40:02.284ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1187
1372024-09-05T00:40:02.284ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-09-05T00:40:02.284ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-09-05T00:40:02.285ZINFOSledAgent (bootstore): Writing ledger to /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-09-05T00:40:02.285ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-09-05T00:40:02.285ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: a014d257-275c-449e-a4f4-aef00eab141c, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-09-05T00:40:02.285ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:60924
1432024-09-05T00:40:02.285ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: a014d257-275c-449e-a4f4-aef00eab141c, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:359
1442024-09-05T00:40:02.285ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:374
1452024-09-05T00:40:02.285ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:451
1462024-09-05T00:40:02.285ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:644
1472024-09-05T00:40:02.285ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1482024-09-05T00:40:02.285ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
1492024-09-05T00:40:02.285ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1502024-09-05T00:40:02.285ZINFOSledAgent (StorageManager): No ledger in /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1512024-09-05T00:40:02.285ZINFOSledAgent (StorageManager): No ledger in /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1522024-09-05T00:40:02.285ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:633
1532024-09-05T00:40:02.285ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:661
1542024-09-05T00:40:02.285ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:440
1552024-09-05T00:40:02.285ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1562024-09-05T00:40:02.285ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:532 result = DisksManagementResult { status: [] }
1572024-09-05T00:40:02.287ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4139
1582024-09-05T00:40:02.287ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4521
1592024-09-05T00:40:02.318ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1602024-09-05T00:40:02.340ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:316
1612024-09-05T00:40:02.357ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1622024-09-05T00:40:02.367ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:388 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
1632024-09-05T00:40:02.367ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1642024-09-05T00:40:02.367ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:400 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
1652024-09-05T00:40:02.367ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1662024-09-05T00:40:02.370ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 91.367337ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7175942c-c3d8-4cfc-8377-f5885040a7b5", "content-length": "124", "date": "Thu, 05 Sep 2024 00:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7175942c-c3d8-4cfc-8377-f5885040a7b5" } file = clients/ddm-admin-client/src/lib.rs:177
1672024-09-05T00:40:02.380ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1682024-09-05T00:40:02.403ZINFOSledAgent: successfully created encrypted zvol: name="oxi_f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1692024-09-05T00:40:02.403ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/swap" file = sled-agent/src/swap_device.rs:96
1702024-09-05T00:40:02.408ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:415 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
1712024-09-05T00:40:02.408ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:127
1722024-09-05T00:40:02.408ZINFOSledAgent (BackingFs): Ensuring dataset oxi_f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/backing/fmd file = sled-agent/src/backing_fs.rs:137
1732024-09-05T00:40:02.463ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1742024-09-05T00:40:02.463ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 73.417357ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "84d1f1bf-4570-4f48-9ad3-56c44fbc7ee4", "content-length": "124", "date": "Thu, 05 Sep 2024 00:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "84d1f1bf-4570-4f48-9ad3-56c44fbc7ee4" } file = clients/ddm-admin-client/src/lib.rs:177
1752024-09-05T00:40:02.490ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:172
1762024-09-05T00:40:02.538ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-09-05T00:40:02.539ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 98.021474ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f936607c-9cb4-4286-b88f-65cbe2b1bd50", "content-length": "124", "date": "Thu, 05 Sep 2024 00:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f936607c-9cb4-4286-b88f-65cbe2b1bd50" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-09-05T00:40:02.638ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-09-05T00:40:02.638ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 162.734164ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9b023871-6837-4c6a-83bd-415c5796f35d", "content-length": "124", "date": "Thu, 05 Sep 2024 00:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9b023871-6837-4c6a-83bd-415c5796f35d" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-09-05T00:40:02.710ZINFOSledAgent (BackingFs): Mounting oxi_f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:180
1812024-09-05T00:40:02.721ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:188
1822024-09-05T00:40:02.722ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:188
1832024-09-05T00:40:02.722ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:188
1842024-09-05T00:40:02.722ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:194
1852024-09-05T00:40:02.802ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-09-05T00:40:02.802ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 183.197706ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5494d60d-b961-4e39-9b94-d3a812992e2c", "content-length": "124", "date": "Thu, 05 Sep 2024 00:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5494d60d-b961-4e39-9b94-d3a812992e2c" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-09-05T00:40:02.987ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-09-05T00:40:02.988ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 165.947339ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b0af61a1-8e8c-432a-b28b-6fc671b32c6a", "content-length": "124", "date": "Thu, 05 Sep 2024 00:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b0af61a1-8e8c-432a-b28b-6fc671b32c6a" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-09-05T00:40:03.155ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1902024-09-05T00:40:03.155ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 194.832484ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "71ef1edc-9936-485c-9e5d-15fbbeada3c1", "content-length": "124", "date": "Thu, 05 Sep 2024 00:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "71ef1edc-9936-485c-9e5d-15fbbeada3c1" } file = clients/ddm-admin-client/src/lib.rs:177
1912024-09-05T00:40:03.350ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1922024-09-05T00:40:03.351ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 360.773955ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3fa8ad4e-db09-4293-ae6a-e4dcf9d13d84", "content-length": "124", "date": "Thu, 05 Sep 2024 00:40:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3fa8ad4e-db09-4293-ae6a-e4dcf9d13d84" } file = clients/ddm-admin-client/src/lib.rs:177
1932024-09-05T00:40:03.453ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
1942024-09-05T00:40:03.459ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:33551 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
1952024-09-05T00:40:03.459ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
1962024-09-05T00:40:03.459ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:33551 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = a014d257-275c-449e-a4f4-aef00eab141c sled_id = a014d257-275c-449e-a4f4-aef00eab141c
1972024-09-05T00:40:03.460ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 126.669727ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
1982024-09-05T00:40:03.461ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
1992024-09-05T00:40:03.461ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
2002024-09-05T00:40:03.461ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:914 underlay_address = fd00:1122:3344:101::1
2012024-09-05T00:40:03.461ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
2022024-09-05T00:40:03.589ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 334.35679ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
2032024-09-05T00:40:03.713ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042024-09-05T00:40:03.925ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.072118366s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
2052024-09-05T00:40:04.999ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.678233021s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
2062024-09-05T00:40:05.793ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2615
2072024-09-05T00:40:05.793ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2833
2082024-09-05T00:40:05.793ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2485
2092024-09-05T00:40:05.793ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2532
2102024-09-05T00:40:05.793ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2914
2112024-09-05T00:40:05.793ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2956
2122024-09-05T00:40:05.795ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2758
2132024-09-05T00:40:05.796ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2526
2142024-09-05T00:40:05.797ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='42b3183c-16e5-4e5a-9353-cb1f595a1c67'/> <propval type="astring" name="rack_id" value='be337c62-4580-4975-a5e7-eb97e51b444b'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe4d:7d1d'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='a014d257-275c-449e-a4f4-aef00eab141c'/> <propval type="astring" name="rack_id" value='be337c62-4580-4975-a5e7-eb97e51b444b'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='a014d257-275c-449e-a4f4-aef00eab141c'/> <propval type="astring" name="rack_uuid" value='be337c62-4580-4975-a5e7-eb97e51b444b'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='a014d257-275c-449e-a4f4-aef00eab141c'/> <propval type="astring" name="rack_uuid" value='be337c62-4580-4975-a5e7-eb97e51b444b'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2152024-09-05T00:40:05.797ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2162024-09-05T00:40:06.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 72.362133ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-09-05T00:40:06.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 87.04334ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-09-05T00:40:06.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 172.032385ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-09-05T00:40:06.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 573.27571ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-09-05T00:40:06.680ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.413279867s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
2212024-09-05T00:40:07.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 405.594545ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-09-05T00:40:07.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.041151159s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-09-05T00:40:08.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.279465393s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-09-05T00:40:10.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.303261884s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-09-05T00:40:11.818ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:12345
2262024-09-05T00:40:11.818ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:429
2272024-09-05T00:40:11.818ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2282024-09-05T00:40:11.818ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2292024-09-05T00:40:11.818ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2302024-09-05T00:40:11.819ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2312024-09-05T00:40:11.819ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:60924
2322024-09-05T00:40:11.819ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, local_pref: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None }], bgp: [], bfd: [] })))
2332024-09-05T00:40:11.819ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3842
2342024-09-05T00:40:11.819ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2352024-09-05T00:40:11.819ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2362024-09-05T00:40:12.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2372024-09-05T00:40:12.066ZINFOSledAgent (RSS): No ledger in /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/rss-service-plan-v4.json file = common/src/ledger.rs:188
2382024-09-05T00:40:12.066ZINFOSledAgent (RSS): No ledger in /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/rss-service-plan-v4.json file = common/src/ledger.rs:188
2392024-09-05T00:40:12.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2402024-09-05T00:40:12.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2412024-09-05T00:40:12.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2422024-09-05T00:40:12.071ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4163 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2432024-09-05T00:40:12.071ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4179
2442024-09-05T00:40:12.071ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2452024-09-05T00:40:12.281ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 7.356180421s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
2462024-09-05T00:40:12.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39816
2472024-09-05T00:40:12.310ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2482024-09-05T00:40:12.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39816 req_id = 10e98b01-9524-4450-aa00-895276861b45 response_code = 200 uri = /inventory
2492024-09-05T00:40:12.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34935
2502024-09-05T00:40:12.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34935 req_id = 56e6bcac-529a-4e6a-aceb-2bbb5e2b78fc response_code = 200 uri = /sled-role
2512024-09-05T00:40:12.342ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2522024-09-05T00:40:12.342ZINFOSledAgent (RSS): Writing ledger to /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/.rss-service-plan-v4.json.tmp file = common/src/ledger.rs:199
2532024-09-05T00:40:12.342ZINFOSledAgent (RSS): Writing ledger to /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/.rss-service-plan-v4.json.tmp file = common/src/ledger.rs:199
2542024-09-05T00:40:12.342ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:999
2552024-09-05T00:40:12.372ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 93298cfa-8663-4ddd-a7f0-a14716d294d1, pool_id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: d37b540d-3270-4659-9aae-4e58031455f1, pool_id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 19b9fd70-3235-4bc3-afce-1cf62963722f, pool_id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 1c8310ad-8ff7-4cc2-ba6d-24752a0325a5, pool_id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 584c4694-b07c-48c4-99dc-f6908baf20d3, pool_id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ac6fecd9-4324-446f-9aab-0c7e5720c213, pool_id: 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 1a035a1b-43d6-48ed-a00c-65a1c496450a, pool_id: 3b890830-afe5-4534-9d63-2368c96a17b2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 48940b85-b2c4-4972-9f49-a3f84fab6ba5, pool_id: f4d0c62d-ea23-4f6c-a7fd-af646b395599 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: a5bc382b-ad5f-45a6-9920-289b86fae0ff, pool_id: 18c638cc-0eb0-43bd-9ec4-4ccc7a05322e (zpool) }] } file = sled-agent/src/rack_setup/service.rs:355 sled_address = [fd00:1122:3344:101::1]:12345
2562024-09-05T00:40:12.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59862
2572024-09-05T00:40:12.373ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:856 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
2582024-09-05T00:40:12.373ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 93298cfa-8663-4ddd-a7f0-a14716d294d1, pool_id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: d37b540d-3270-4659-9aae-4e58031455f1, pool_id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 19b9fd70-3235-4bc3-afce-1cf62963722f, pool_id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 1c8310ad-8ff7-4cc2-ba6d-24752a0325a5, pool_id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 584c4694-b07c-48c4-99dc-f6908baf20d3, pool_id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ac6fecd9-4324-446f-9aab-0c7e5720c213, pool_id: 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 1a035a1b-43d6-48ed-a00c-65a1c496450a, pool_id: 3b890830-afe5-4534-9d63-2368c96a17b2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 48940b85-b2c4-4972-9f49-a3f84fab6ba5, pool_id: f4d0c62d-ea23-4f6c-a7fd-af646b395599 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: a5bc382b-ad5f-45a6-9920-289b86fae0ff, pool_id: 18c638cc-0eb0-43bd-9ec4-4ccc7a05322e (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:451
2592024-09-05T00:40:12.373ZINFOSledAgent (StorageManager): No ledger in /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602024-09-05T00:40:12.373ZINFOSledAgent (StorageManager): No ledger in /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2612024-09-05T00:40:12.373ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:866 request = omicron_physical_disks_ensure
2622024-09-05T00:40:12.373ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2632024-09-05T00:40:12.373ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2642024-09-05T00:40:12.373ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2652024-09-05T00:40:12.373ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2662024-09-05T00:40:12.534ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:360
2672024-09-05T00:40:12.534ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 07758950-4365-4426-bdcd-a3906ef0719c (zpool)
2682024-09-05T00:40:13.012ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a014d257-275c-449e-a4f4-aef00eab141c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
2692024-09-05T00:40:13.688ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
2702024-09-05T00:40:13.700ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }
2712024-09-05T00:40:13.709ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:218
2722024-09-05T00:40:13.709ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:220
2732024-09-05T00:40:13.709ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:224
2742024-09-05T00:40:13.709ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:226
2752024-09-05T00:40:13.709ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762024-09-05T00:40:13.709ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2772024-09-05T00:40:13.709ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
2782024-09-05T00:40:13.743ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2792024-09-05T00:40:13.752ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_07758950-4365-4426-bdcd-a3906ef0719c/crypt/zone file = sled-storage/src/dataset.rs:281
2802024-09-05T00:40:13.922ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_07758950-4365-4426-bdcd-a3906ef0719c file = sled-storage/src/dataset.rs:367
2812024-09-05T00:40:13.930ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2822024-09-05T00:40:13.930ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2832024-09-05T00:40:13.930ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2842024-09-05T00:40:13.930ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2852024-09-05T00:40:13.930ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2862024-09-05T00:40:13.941ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:360
2872024-09-05T00:40:13.941ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool)
2882024-09-05T00:40:14.036ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }
2892024-09-05T00:40:14.044ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:218
2902024-09-05T00:40:14.044ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:220
2912024-09-05T00:40:14.044ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:224
2922024-09-05T00:40:14.044ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:226
2932024-09-05T00:40:14.044ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-09-05T00:40:14.044ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952024-09-05T00:40:14.044ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
2962024-09-05T00:40:14.048ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a014d257-275c-449e-a4f4-aef00eab141c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
2972024-09-05T00:40:14.082ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2982024-09-05T00:40:14.090ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3149c6f5-adf9-4e42-9a6f-ea817157070d/crypt/zone file = sled-storage/src/dataset.rs:281
2992024-09-05T00:40:14.266ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3149c6f5-adf9-4e42-9a6f-ea817157070d file = sled-storage/src/dataset.rs:367
3002024-09-05T00:40:14.275ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3012024-09-05T00:40:14.275ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3022024-09-05T00:40:14.275ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3032024-09-05T00:40:14.275ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3042024-09-05T00:40:14.275ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3052024-09-05T00:40:14.284ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:360
3062024-09-05T00:40:14.284ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool)
3072024-09-05T00:40:14.379ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }
3082024-09-05T00:40:14.387ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:218
3092024-09-05T00:40:14.387ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:220
3102024-09-05T00:40:14.387ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:224
3112024-09-05T00:40:14.387ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:226
3122024-09-05T00:40:14.387ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132024-09-05T00:40:14.387ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3142024-09-05T00:40:14.387ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
3152024-09-05T00:40:14.423ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3162024-09-05T00:40:14.431ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_47f9ab94-cb52-4abd-b519-311e83310dbb/crypt/zone file = sled-storage/src/dataset.rs:281
3172024-09-05T00:40:14.604ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_47f9ab94-cb52-4abd-b519-311e83310dbb file = sled-storage/src/dataset.rs:367
3182024-09-05T00:40:14.612ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3192024-09-05T00:40:14.612ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3202024-09-05T00:40:14.612ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3212024-09-05T00:40:14.612ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3222024-09-05T00:40:14.612ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3232024-09-05T00:40:14.622ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:360
3242024-09-05T00:40:14.622ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool)
3252024-09-05T00:40:14.712ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External }
3262024-09-05T00:40:14.720ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:218
3272024-09-05T00:40:14.720ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:220
3282024-09-05T00:40:14.720ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:224
3292024-09-05T00:40:14.720ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:226
3302024-09-05T00:40:14.720ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-09-05T00:40:14.720ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322024-09-05T00:40:14.720ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
3332024-09-05T00:40:14.757ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3342024-09-05T00:40:14.765ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cd6b3ed7-21c7-4782-a335-8ab89ee4c355/crypt/zone file = sled-storage/src/dataset.rs:281
3352024-09-05T00:40:14.937ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cd6b3ed7-21c7-4782-a335-8ab89ee4c355 file = sled-storage/src/dataset.rs:367
3362024-09-05T00:40:14.945ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3372024-09-05T00:40:14.945ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3382024-09-05T00:40:14.945ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3392024-09-05T00:40:14.945ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3402024-09-05T00:40:14.945ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3412024-09-05T00:40:14.955ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:360
3422024-09-05T00:40:14.955ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool)
3432024-09-05T00:40:15.050ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }
3442024-09-05T00:40:15.058ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:218
3452024-09-05T00:40:15.058ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:220
3462024-09-05T00:40:15.058ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:224
3472024-09-05T00:40:15.058ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:226
3482024-09-05T00:40:15.058ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-09-05T00:40:15.058ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502024-09-05T00:40:15.058ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
3512024-09-05T00:40:15.062ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a014d257-275c-449e-a4f4-aef00eab141c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
3522024-09-05T00:40:15.095ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3532024-09-05T00:40:15.105ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5e93ddc1-113d-4d72-b455-60d0ee285e5b/crypt/zone file = sled-storage/src/dataset.rs:281
3542024-09-05T00:40:15.277ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5e93ddc1-113d-4d72-b455-60d0ee285e5b file = sled-storage/src/dataset.rs:367
3552024-09-05T00:40:15.285ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3562024-09-05T00:40:15.285ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3572024-09-05T00:40:15.285ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3582024-09-05T00:40:15.285ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3592024-09-05T00:40:15.285ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3602024-09-05T00:40:15.295ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:360
3612024-09-05T00:40:15.295ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool)
3622024-09-05T00:40:15.387ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool), kind: External }
3632024-09-05T00:40:15.394ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:218
3642024-09-05T00:40:15.394ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:220
3652024-09-05T00:40:15.394ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:224
3662024-09-05T00:40:15.394ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:226
3672024-09-05T00:40:15.394ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682024-09-05T00:40:15.394ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3692024-09-05T00:40:15.394ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
3702024-09-05T00:40:15.428ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3712024-09-05T00:40:15.436ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crypt/zone file = sled-storage/src/dataset.rs:281
3722024-09-05T00:40:15.613ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0992886b-7bd4-4261-afe1-662fbe130da8 file = sled-storage/src/dataset.rs:367
3732024-09-05T00:40:15.621ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3742024-09-05T00:40:15.621ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3752024-09-05T00:40:15.621ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3762024-09-05T00:40:15.621ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3772024-09-05T00:40:15.621ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3782024-09-05T00:40:15.630ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:360
3792024-09-05T00:40:15.630ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 3b890830-afe5-4534-9d63-2368c96a17b2 (zpool)
3802024-09-05T00:40:15.727ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 3b890830-afe5-4534-9d63-2368c96a17b2 (zpool), kind: External }
3812024-09-05T00:40:15.735ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:218
3822024-09-05T00:40:15.735ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:220
3832024-09-05T00:40:15.735ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:224
3842024-09-05T00:40:15.735ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:226
3852024-09-05T00:40:15.735ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-09-05T00:40:15.735ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872024-09-05T00:40:15.735ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
3882024-09-05T00:40:15.772ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892024-09-05T00:40:15.780ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3b890830-afe5-4534-9d63-2368c96a17b2/crypt/zone file = sled-storage/src/dataset.rs:281
3902024-09-05T00:40:15.960ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3b890830-afe5-4534-9d63-2368c96a17b2 file = sled-storage/src/dataset.rs:367
3912024-09-05T00:40:15.969ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3922024-09-05T00:40:15.969ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3932024-09-05T00:40:15.969ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3942024-09-05T00:40:15.969ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952024-09-05T00:40:15.969ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962024-09-05T00:40:15.979ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:360
3972024-09-05T00:40:15.979ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = f4d0c62d-ea23-4f6c-a7fd-af646b395599 (zpool)
3982024-09-05T00:40:16.081ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: f4d0c62d-ea23-4f6c-a7fd-af646b395599 (zpool), kind: External }
3992024-09-05T00:40:16.089ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:218
4002024-09-05T00:40:16.089ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:220
4012024-09-05T00:40:16.089ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:224
4022024-09-05T00:40:16.089ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:226
4032024-09-05T00:40:16.089ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-09-05T00:40:16.089ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-09-05T00:40:16.089ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
4062024-09-05T00:40:16.093ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a014d257-275c-449e-a4f4-aef00eab141c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
4072024-09-05T00:40:16.125ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4082024-09-05T00:40:16.133ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f4d0c62d-ea23-4f6c-a7fd-af646b395599/crypt/zone file = sled-storage/src/dataset.rs:281
4092024-09-05T00:40:16.313ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f4d0c62d-ea23-4f6c-a7fd-af646b395599 file = sled-storage/src/dataset.rs:367
4102024-09-05T00:40:16.322ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4112024-09-05T00:40:16.322ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4122024-09-05T00:40:16.322ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4132024-09-05T00:40:16.322ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4142024-09-05T00:40:16.322ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4152024-09-05T00:40:16.332ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:360
4162024-09-05T00:40:16.333ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 18c638cc-0eb0-43bd-9ec4-4ccc7a05322e (zpool)
4172024-09-05T00:40:16.431ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 18c638cc-0eb0-43bd-9ec4-4ccc7a05322e (zpool), kind: External }
4182024-09-05T00:40:16.440ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:218
4192024-09-05T00:40:16.440ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:220
4202024-09-05T00:40:16.440ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:224
4212024-09-05T00:40:16.440ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:226
4222024-09-05T00:40:16.440ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-09-05T00:40:16.440ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4242024-09-05T00:40:16.440ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
4252024-09-05T00:40:16.477ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4262024-09-05T00:40:16.486ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_18c638cc-0eb0-43bd-9ec4-4ccc7a05322e/crypt/zone file = sled-storage/src/dataset.rs:281
4272024-09-05T00:40:16.665ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_18c638cc-0eb0-43bd-9ec4-4ccc7a05322e file = sled-storage/src/dataset.rs:367
4282024-09-05T00:40:16.673ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4292024-09-05T00:40:16.673ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4302024-09-05T00:40:16.673ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312024-09-05T00:40:16.674ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2455a9c8-fd1a-4dff-b957-96f508caa645 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3b890830-afe5-4534-9d63-2368c96a17b2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f4d0c62d-ea23-4f6c-a7fd-af646b395599 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 18c638cc-0eb0-43bd-9ec4-4ccc7a05322e (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4322024-09-05T00:40:16.674ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4332024-09-05T00:40:16.674ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4342024-09-05T00:40:16.674ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4352024-09-05T00:40:16.674ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:860 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
4362024-09-05T00:40:16.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4372024-09-05T00:40:16.674ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:886 generation = Generation(1) sled_id = a014d257-275c-449e-a4f4-aef00eab141c
4382024-09-05T00:40:16.674ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:891 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
4392024-09-05T00:40:16.674ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:896 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
4402024-09-05T00:40:16.674ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:121 gen = Generation(1) sled_id = a014d257-275c-449e-a4f4-aef00eab141c
4412024-09-05T00:40:16.674ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:902 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
4422024-09-05T00:40:16.674ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:803 gen = Generation(1)
4432024-09-05T00:40:16.674ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:907 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
4442024-09-05T00:40:16.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4301989 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59862 req_id = e3c910c0-935b-43c4-81dc-0ea9b977ab19 response_code = 200 uri = /omicron-physical-disks
4452024-09-05T00:40:16.706ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 89145bfe-85a8-47ae-9826-e73f4757fe92, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
4462024-09-05T00:40:16.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47080
4472024-09-05T00:40:16.707ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4482024-09-05T00:40:16.707ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: InternalDns }, responder: ... }
4492024-09-05T00:40:16.757ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 89145bfe-85a8-47ae-9826-e73f4757fe92, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4502024-09-05T00:40:16.757ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 89145bfe-85a8-47ae-9826-e73f4757fe92, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: InternalDns }, responder: ... }
4512024-09-05T00:40:16.807ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4522024-09-05T00:40:16.807ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: InternalDns }, responder: ... }
4532024-09-05T00:40:16.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4542024-09-05T00:40:16.856ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/omicron-zones.json file = common/src/ledger.rs:188
4552024-09-05T00:40:16.857ZINFOSledAgent (ServiceManager): No ledger in /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/omicron-zones.json file = common/src/ledger.rs:188
4562024-09-05T00:40:16.857ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4572024-09-05T00:40:16.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4582024-09-05T00:40:16.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4592024-09-05T00:40:16.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4602024-09-05T00:40:16.949ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92 file = illumos-utils/src/zone.rs:316
4612024-09-05T00:40:16.953ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f file = illumos-utils/src/zone.rs:316
4622024-09-05T00:40:16.957ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb file = illumos-utils/src/zone.rs:316
4632024-09-05T00:40:16.969ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92 file = illumos-utils/src/zone.rs:354
4642024-09-05T00:40:16.973ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f file = illumos-utils/src/zone.rs:354
4652024-09-05T00:40:16.978ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb file = illumos-utils/src/zone.rs:354
4662024-09-05T00:40:17.096ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a014d257-275c-449e-a4f4-aef00eab141c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
4672024-09-05T00:40:18.491ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4682024-09-05T00:40:18.491ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4692024-09-05T00:40:18.969ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4702024-09-05T00:40:18.969ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
4712024-09-05T00:40:18.973ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4722024-09-05T00:40:19.452ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4732024-09-05T00:40:19.454ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f
4742024-09-05T00:40:19.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb") failed: Property not found. retry in 41.840829ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
4752024-09-05T00:40:19.473ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4762024-09-05T00:40:19.473ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92
4772024-09-05T00:40:19.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb") failed: Property not found. retry in 95.706115ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
4782024-09-05T00:40:19.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f") failed: Property not found. retry in 27.16138ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f
4792024-09-05T00:40:19.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92") failed: Property not found. retry in 52.278385ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92
4802024-09-05T00:40:19.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f") failed: Property not found. retry in 140.420008ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f
4812024-09-05T00:40:19.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb") failed: Property not found. retry in 110.855206ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
4822024-09-05T00:40:19.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92") failed: Property not found. retry in 91.728926ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92
4832024-09-05T00:40:19.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb") failed: Property not found. retry in 266.824801ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
4842024-09-05T00:40:19.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92") failed: Property not found. retry in 132.187216ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92
4852024-09-05T00:40:19.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f") failed: Property not found. retry in 116.001825ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f
4862024-09-05T00:40:20.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92") failed: Property not found. retry in 234.32062ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92
4872024-09-05T00:40:20.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f") failed: Property not found. retry in 290.037858ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f
4882024-09-05T00:40:20.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb") failed: Property not found. retry in 482.061016ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
4892024-09-05T00:40:20.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92") failed: Property not found. retry in 497.084381ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92
4902024-09-05T00:40:20.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f") failed: Property not found. retry in 584.417905ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f
4912024-09-05T00:40:20.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb") failed: Property not found. retry in 581.591799ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
4922024-09-05T00:40:20.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92") failed: Property not found. retry in 568.092098ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92
4932024-09-05T00:40:20.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f") failed: Property not found. retry in 630.033474ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f
4942024-09-05T00:40:21.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb") failed: Property not found. retry in 1.106670021s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
4952024-09-05T00:40:21.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92") failed: Property not found. retry in 999.59208ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92
4962024-09-05T00:40:21.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f") failed: Property not found. retry in 816.902021ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f
4972024-09-05T00:40:22.118ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4187
4982024-09-05T00:40:22.118ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4197 gateway = fd00:1122:3344:101::1
4992024-09-05T00:40:22.124ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4276
5002024-09-05T00:40:22.249ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4324
5012024-09-05T00:40:22.249ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4351
5022024-09-05T00:40:22.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb") failed: Property not found. retry in 730.528218ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
5032024-09-05T00:40:22.289ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4364
5042024-09-05T00:40:22.289ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4228
5052024-09-05T00:40:22.340ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4270
5062024-09-05T00:40:22.340ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4331 rack_subnet = fd00:1122:3344::
5072024-09-05T00:40:22.360ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4342
5082024-09-05T00:40:22.360ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4384
5092024-09-05T00:40:22.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92") failed: Property not found. retry in 1.100385472s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92
5102024-09-05T00:40:22.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f") failed: Property not found. retry in 1.468792035s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f
5112024-09-05T00:40:22.451ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4416
5122024-09-05T00:40:22.451ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4422
5132024-09-05T00:40:22.559ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4463
5142024-09-05T00:40:22.559ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:366
5152024-09-05T00:40:22.594ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a014d257-275c-449e-a4f4-aef00eab141c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:571 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
5162024-09-05T00:40:22.595ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:414
5172024-09-05T00:40:22.628ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:676
5182024-09-05T00:40:22.628ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:714
5192024-09-05T00:40:22.628ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:717 uptime = 0
5202024-09-05T00:40:22.628ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:436
5212024-09-05T00:40:22.668ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
5222024-09-05T00:40:22.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:53569
5232024-09-05T00:40:22.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:53569 req_id = 540b4a2e-415f-49a7-b545-3b9e1be9229d response_code = 200 uri = /sled-identifiers
5242024-09-05T00:40:22.717ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
5252024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5262024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5272024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5282024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5292024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5302024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5312024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5322024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5332024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5342024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5352024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5362024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5372024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5382024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5392024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5402024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5412024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5422024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5432024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5442024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5452024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5462024-09-05T00:40:22.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5472024-09-05T00:40:23.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb") failed: Property not found. retry in 1.056437155s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
5482024-09-05T00:40:23.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92") failed: Property not found. retry in 1.285852895s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92
5492024-09-05T00:40:23.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f") failed: Property not found. retry in 1.174628101s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f
5502024-09-05T00:40:24.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb") failed: Property not found. retry in 1.332346248s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
5512024-09-05T00:40:25.429ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_internal_dns_89145bfe-85a8-47ae-9826-e73f4757fe92
5522024-09-05T00:40:25.429ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_internal_dns_0c51ae87-cbaf-4403-8e7a-91ae1f6a480f
5532024-09-05T00:40:25.429ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_internal_dns_972980d1-78ce-4b3e-8b23-36e1a0e30ffb
5542024-09-05T00:40:25.429ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5552024-09-05T00:40:25.429ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5562024-09-05T00:40:25.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8722992 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47080 req_id = db023744-a43d-43c4-b168-ed99d82ab7ae response_code = 204 uri = /omicron-zones
5572024-09-05T00:40:25.431ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5582024-09-05T00:40:25.479ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5592024-09-05T00:40:25.525ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5602024-09-05T00:40:25.572ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:591
5612024-09-05T00:40:25.572ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5622024-09-05T00:40:25.603ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5632024-09-05T00:40:25.604ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5642024-09-05T00:40:25.604ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5652024-09-05T00:40:25.633ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 89145bfe-85a8-47ae-9826-e73f4757fe92, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 12515ac3-ec02-4a77-94ca-e3454dcd9f1e, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 6ddad7d1-6368-48d2-afbc-48d82c861e83, kind: Service { id: 12515ac3-ec02-4a77-94ca-e3454dcd9f1e }, name: Name("ntp-12515ac3-ec02-4a77-94ca-e3454dcd9f1e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 205])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
5662024-09-05T00:40:25.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43975
5672024-09-05T00:40:25.634ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5682024-09-05T00:40:25.634ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: InternalDns }, responder: ... }
5692024-09-05T00:40:25.654ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 89145bfe-85a8-47ae-9826-e73f4757fe92, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5702024-09-05T00:40:25.654ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 89145bfe-85a8-47ae-9826-e73f4757fe92, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: InternalDns }, responder: ... }
5712024-09-05T00:40:25.669ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5722024-09-05T00:40:25.669ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: InternalDns }, responder: ... }
5732024-09-05T00:40:25.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5742024-09-05T00:40:25.684ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/omicron-zones.json file = common/src/ledger.rs:177
5752024-09-05T00:40:25.684ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/omicron-zones.json file = common/src/ledger.rs:177
5762024-09-05T00:40:25.684ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5772024-09-05T00:40:25.694ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5782024-09-05T00:40:25.727ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5792024-09-05T00:40:25.728ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5802024-09-05T00:40:25.728ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5812024-09-05T00:40:25.759ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 131, 205]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5822024-09-05T00:40:25.759ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = boundary_ntp
5832024-09-05T00:40:25.761ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
5842024-09-05T00:40:25.761ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
5852024-09-05T00:40:25.761ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
5862024-09-05T00:40:25.762ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5872024-09-05T00:40:25.783ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e file = illumos-utils/src/zone.rs:316
5882024-09-05T00:40:25.801ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e file = illumos-utils/src/zone.rs:354
5892024-09-05T00:40:26.420ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5902024-09-05T00:40:26.420ZINFOSledAgent (ServiceManager): Booting oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e
5912024-09-05T00:40:26.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e") failed: Property not found. retry in 72.957247ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e
5922024-09-05T00:40:26.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e") failed: Property not found. retry in 120.510535ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e
5932024-09-05T00:40:26.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e") failed: Property not found. retry in 274.539577ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e
5942024-09-05T00:40:27.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e") failed: Property not found. retry in 498.099798ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e
5952024-09-05T00:40:27.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e") failed: Property not found. retry in 1.015895374s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e
5962024-09-05T00:40:28.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e") failed: Property not found. retry in 884.343603ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e
5972024-09-05T00:40:29.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e") failed: Property not found. retry in 759.465916ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e
5982024-09-05T00:40:30.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e") failed: Property not found. retry in 1.488646686s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e
5992024-09-05T00:40:31.778ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e
6002024-09-05T00:40:31.778ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6012024-09-05T00:40:31.778ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6022024-09-05T00:40:31.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6144819 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43975 req_id = 0cc6db8b-c7ca-4b02-88e8-447e3c639493 response_code = 204 uri = /omicron-zones
6032024-09-05T00:40:31.781ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:632
6042024-09-05T00:40:31.812ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6052024-09-05T00:40:31.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37895
6062024-09-05T00:40:31.821ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3828
6072024-09-05T00:40:31.821ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 8306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37895 req_id = 486797b4-2585-4b08-8c8f-216bbcba78d6 response_code = 500 uri = /timesync
6082024-09-05T00:40:31.823ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6092024-09-05T00:40:31.907ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6102024-09-05T00:40:31.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42896
6112024-09-05T00:40:33.917ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3828
6122024-09-05T00:40:33.917ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 2009114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42896 req_id = 413d0254-4be9-404c-99b1-16fa8c9365a1 response_code = 500 uri = /timesync
6132024-09-05T00:40:33.920ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6142024-09-05T00:40:34.046ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6152024-09-05T00:40:34.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50808
6162024-09-05T00:40:34.055ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3828
6172024-09-05T00:40:34.055ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 9001 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50808 req_id = dbcc47e6-d628-496a-8775-f38ff55a20ca response_code = 500 uri = /timesync
6182024-09-05T00:40:34.059ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6192024-09-05T00:40:34.302ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6202024-09-05T00:40:34.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64096
6212024-09-05T00:40:34.310ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_12515ac3-ec02-4a77-94ca-e3454dcd9f1e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3828
6222024-09-05T00:40:34.310ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 7985 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64096 req_id = 34c688f4-753a-47bc-ab16-fab12b35f26a response_code = 500 uri = /timesync
6232024-09-05T00:40:34.311ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6242024-09-05T00:40:34.469ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6252024-09-05T00:40:34.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55501
6262024-09-05T00:40:38.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4008568 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55501 req_id = 41dbe252-7116-454e-9868-63ef4b57d342 response_code = 200 uri = /timesync
6272024-09-05T00:40:38.481ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6282024-09-05T00:40:38.481ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6292024-09-05T00:40:38.736ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6302024-09-05T00:40:38.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52735
6312024-09-05T00:40:38.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8662 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52735 req_id = 772f43fb-1c85-4e8c-920e-af32575801eb response_code = 200 uri = /timesync
6322024-09-05T00:40:38.748ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6332024-09-05T00:40:38.748ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6342024-09-05T00:40:38.949ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6352024-09-05T00:40:38.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56291
6362024-09-05T00:40:39.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56291 req_id = 9215f216-4c7b-4112-9cf9-28d18da8620b response_code = 200 uri = /timesync
6372024-09-05T00:40:39.003ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6382024-09-05T00:40:39.003ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6392024-09-05T00:40:39.305ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6402024-09-05T00:40:39.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59103
6412024-09-05T00:40:39.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8480 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59103 req_id = 9e322768-cd32-4a0b-8251-470fd44e5557 response_code = 200 uri = /timesync
6422024-09-05T00:40:39.317ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.060902417 } file = sled-agent/src/rack_setup/service.rs:640
6432024-09-05T00:40:39.317ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6442024-09-05T00:40:39.563ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6452024-09-05T00:40:39.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38359
6462024-09-05T00:40:39.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7437 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38359 req_id = 3819802d-75db-46a4-ab66-14cf9c98f1bc response_code = 200 uri = /timesync
6472024-09-05T00:40:39.572ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.060208663 } file = sled-agent/src/rack_setup/service.rs:640
6482024-09-05T00:40:39.572ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6492024-09-05T00:40:40.209ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6502024-09-05T00:40:40.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40250
6512024-09-05T00:40:40.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7388 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40250 req_id = d156b488-e009-4d70-b378-5b3739283520 response_code = 200 uri = /timesync
6522024-09-05T00:40:40.218ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 760180594, ip_addr: 45.79.111.114, stratum: 3, ref_time: 1725496840.014536, correction: 0.060673255 } file = sled-agent/src/rack_setup/service.rs:640
6532024-09-05T00:40:40.218ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6542024-09-05T00:40:40.761ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6552024-09-05T00:40:40.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64381
6562024-09-05T00:40:40.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8403 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 8e642c6d-3073-4e01-b0cb-3e4d767e25bf response_code = 200 uri = /timesync
6572024-09-05T00:40:40.773ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1725496839.4126236, correction: 0.059177458 } file = sled-agent/src/rack_setup/service.rs:640
6582024-09-05T00:40:40.773ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6592024-09-05T00:40:41.306ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6602024-09-05T00:40:41.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58757
6612024-09-05T00:40:41.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8089 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58757 req_id = 2d249912-1fd4-40ed-8c4f-b1a4d70e84de response_code = 200 uri = /timesync
6622024-09-05T00:40:41.317ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1725496839.4126236, correction: 0.058117673 } file = sled-agent/src/rack_setup/service.rs:640
6632024-09-05T00:40:41.317ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6642024-09-05T00:40:42.217ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6652024-09-05T00:40:42.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55753
6662024-09-05T00:40:42.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7996 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55753 req_id = 1ddd3560-61e8-4eb6-9255-027c3e144fbe response_code = 200 uri = /timesync
6672024-09-05T00:40:42.228ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1725496839.4126236, correction: 0.056001041 } file = sled-agent/src/rack_setup/service.rs:640
6682024-09-05T00:40:42.228ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6692024-09-05T00:40:43.048ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6702024-09-05T00:40:43.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42251
6712024-09-05T00:40:43.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7995 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42251 req_id = a1182e68-2f0e-4eea-a345-f9aedda840f8 response_code = 200 uri = /timesync
6722024-09-05T00:40:43.058ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1725496839.4126236, correction: 0.05375826 } file = sled-agent/src/rack_setup/service.rs:640
6732024-09-05T00:40:43.058ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6742024-09-05T00:40:43.793ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6752024-09-05T00:40:43.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41671
6762024-09-05T00:40:43.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8675 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41671 req_id = de0b9d98-1f1b-4941-939c-e83b6d209036 response_code = 200 uri = /timesync
6772024-09-05T00:40:43.804ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1725496839.4126236, correction: 0.051629208 } file = sled-agent/src/rack_setup/service.rs:640
6782024-09-05T00:40:43.804ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6792024-09-05T00:40:44.735ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 156.239498ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
6802024-09-05T00:40:45.555ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6812024-09-05T00:40:45.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40579
6822024-09-05T00:40:45.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 21889 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40579 req_id = b794a7d3-06c1-4915-a121-ac37a0ca23cb response_code = 200 uri = /timesync
6832024-09-05T00:40:45.581ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 760180594, ip_addr: 45.79.111.114, stratum: 3, ref_time: 1725496844.8229296, correction: 0.0463426 } file = sled-agent/src/rack_setup/service.rs:640
6842024-09-05T00:40:45.581ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1266
6852024-09-05T00:40:45.612ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 89145bfe-85a8-47ae-9826-e73f4757fe92, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 12515ac3-ec02-4a77-94ca-e3454dcd9f1e, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 6ddad7d1-6368-48d2-afbc-48d82c861e83, kind: Service { id: 12515ac3-ec02-4a77-94ca-e3454dcd9f1e }, name: Name("ntp-12515ac3-ec02-4a77-94ca-e3454dcd9f1e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 205])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: d0c615c8-bdeb-49a0-816f-a566dcc3c131, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External } } } }, OmicronZoneConfig { id: a82c21c2-881c-4e81-ac17-f918e403fe8a, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External } } } }, OmicronZoneConfig { id: 7e3770ec-e483-41f5-acee-387c91143c60, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External } } } }, OmicronZoneConfig { id: 88e1f7e1-054c-4757-a614-b8a4dd3daa0a, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External } } } }, OmicronZoneConfig { id: c91c6de7-fb5b-415a-adfd-671600a2a2ab, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
6862024-09-05T00:40:45.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35557
6872024-09-05T00:40:45.612ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6882024-09-05T00:40:45.612ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: InternalDns }, responder: ... }
6892024-09-05T00:40:45.632ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 89145bfe-85a8-47ae-9826-e73f4757fe92, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6902024-09-05T00:40:45.632ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 89145bfe-85a8-47ae-9826-e73f4757fe92, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6912024-09-05T00:40:45.651ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6922024-09-05T00:40:45.651ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: InternalDns }, responder: ... }
6932024-09-05T00:40:45.667ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d0c615c8-bdeb-49a0-816f-a566dcc3c131, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6942024-09-05T00:40:45.667ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: d0c615c8-bdeb-49a0-816f-a566dcc3c131, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: Cockroach }, responder: ... }
6952024-09-05T00:40:45.719ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a82c21c2-881c-4e81-ac17-f918e403fe8a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6962024-09-05T00:40:45.719ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: a82c21c2-881c-4e81-ac17-f918e403fe8a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: Cockroach }, responder: ... }
6972024-09-05T00:40:45.770ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7e3770ec-e483-41f5-acee-387c91143c60, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6982024-09-05T00:40:45.770ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 7e3770ec-e483-41f5-acee-387c91143c60, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: Cockroach }, responder: ... }
6992024-09-05T00:40:45.816ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 88e1f7e1-054c-4757-a614-b8a4dd3daa0a, dataset_name: DatasetName { pool_name: ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7002024-09-05T00:40:45.816ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 88e1f7e1-054c-4757-a614-b8a4dd3daa0a, dataset_name: DatasetName { pool_name: ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7012024-09-05T00:40:45.865ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c91c6de7-fb5b-415a-adfd-671600a2a2ab, dataset_name: DatasetName { pool_name: ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7022024-09-05T00:40:45.865ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: c91c6de7-fb5b-415a-adfd-671600a2a2ab, dataset_name: DatasetName { pool_name: ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }, kind: Cockroach }, responder: ... }
7032024-09-05T00:40:45.916ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7042024-09-05T00:40:45.916ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/omicron-zones.json file = common/src/ledger.rs:177
7052024-09-05T00:40:45.916ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/omicron-zones.json file = common/src/ledger.rs:177
7062024-09-05T00:40:45.916ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7072024-09-05T00:40:45.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7082024-09-05T00:40:45.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7092024-09-05T00:40:45.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7102024-09-05T00:40:45.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7112024-09-05T00:40:45.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7122024-09-05T00:40:46.091ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131 file = illumos-utils/src/zone.rs:316
7132024-09-05T00:40:46.095ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60 file = illumos-utils/src/zone.rs:316
7142024-09-05T00:40:46.099ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a file = illumos-utils/src/zone.rs:316
7152024-09-05T00:40:46.103ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab file = illumos-utils/src/zone.rs:316
7162024-09-05T00:40:46.107ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a file = illumos-utils/src/zone.rs:316
7172024-09-05T00:40:46.112ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131 file = illumos-utils/src/zone.rs:354
7182024-09-05T00:40:46.116ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60 file = illumos-utils/src/zone.rs:354
7192024-09-05T00:40:46.121ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a file = illumos-utils/src/zone.rs:354
7202024-09-05T00:40:46.125ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab file = illumos-utils/src/zone.rs:354
7212024-09-05T00:40:46.130ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a file = illumos-utils/src/zone.rs:354
7222024-09-05T00:40:49.100ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d0c615c8-bdeb-49a0-816f-a566dcc3c131'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7232024-09-05T00:40:49.100ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7242024-09-05T00:40:49.141ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7e3770ec-e483-41f5-acee-387c91143c60'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7252024-09-05T00:40:49.141ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7262024-09-05T00:40:49.158ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='88e1f7e1-054c-4757-a614-b8a4dd3daa0a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7272024-09-05T00:40:49.158ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7282024-09-05T00:40:49.171ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c91c6de7-fb5b-415a-adfd-671600a2a2ab'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7292024-09-05T00:40:49.171ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7302024-09-05T00:40:49.201ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a82c21c2-881c-4e81-ac17-f918e403fe8a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7312024-09-05T00:40:49.201ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7322024-09-05T00:40:49.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 67.774092ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7332024-09-05T00:40:49.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 27.940999ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7342024-09-05T00:40:49.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a") failed: Property not found. retry in 69.17789ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7352024-09-05T00:40:49.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 63.7134ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7362024-09-05T00:40:49.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 107.761445ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7372024-09-05T00:40:49.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 87.498179ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7382024-09-05T00:40:49.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 57.255819ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7392024-09-05T00:40:49.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 156.846726ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7402024-09-05T00:40:49.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 114.547129ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7412024-09-05T00:40:50.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a") failed: Property not found. retry in 97.257595ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7422024-09-05T00:40:50.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 120.323524ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7432024-09-05T00:40:50.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 361.127165ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7442024-09-05T00:40:50.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 260.117217ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7452024-09-05T00:40:51.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a") failed: Property not found. retry in 296.606232ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7462024-09-05T00:40:51.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 231.006056ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7472024-09-05T00:40:51.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 100.9865ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7482024-09-05T00:40:51.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 597.947907ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7492024-09-05T00:40:51.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 487.629445ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7502024-09-05T00:40:51.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a") failed: Property not found. retry in 536.347829ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7512024-09-05T00:40:51.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 289.1148ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7522024-09-05T00:40:51.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 556.025078ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7532024-09-05T00:40:52.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 506.818633ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7542024-09-05T00:40:52.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 1.310277577s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7552024-09-05T00:40:52.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a") failed: Property not found. retry in 751.232704ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7562024-09-05T00:40:52.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 883.092639ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7572024-09-05T00:40:52.418ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65193
7582024-09-05T00:40:52.418ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65193 req_id = fab82dae-1aa1-46d9-9ddc-c666962e3a38 response_code = 200 uri = /baseboard
7592024-09-05T00:40:52.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 913.586807ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7602024-09-05T00:40:52.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 890.031284ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7612024-09-05T00:40:53.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a") failed: Property not found. retry in 1.368194746s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7622024-09-05T00:40:53.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 698.992756ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7632024-09-05T00:40:53.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 1.414943181s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7642024-09-05T00:40:53.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 898.463373ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7652024-09-05T00:40:53.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 862.078204ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7662024-09-05T00:40:53.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 1.472988575s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7672024-09-05T00:40:54.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 527.821428ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7682024-09-05T00:40:54.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 501.484556ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7692024-09-05T00:40:54.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a") failed: Property not found. retry in 878.888509ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7702024-09-05T00:40:54.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 1.419256013s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7712024-09-05T00:40:54.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 1.211076566s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7722024-09-05T00:40:55.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 860.73766ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7732024-09-05T00:40:55.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a") failed: Property not found. retry in 1.496418941s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7742024-09-05T00:40:55.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 948.141353ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7752024-09-05T00:40:55.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 744.305325ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7762024-09-05T00:40:56.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 1.323958886s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7772024-09-05T00:40:56.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 531.228676ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7782024-09-05T00:40:56.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 1.326034555s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7792024-09-05T00:40:56.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 1.381995465s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7802024-09-05T00:40:56.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 1.232236907s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7812024-09-05T00:40:56.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a") failed: Property not found. retry in 998.203149ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7822024-09-05T00:40:57.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 1.174908309s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7832024-09-05T00:40:57.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 513.987025ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7842024-09-05T00:40:57.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a") failed: Property not found. retry in 1.282086586s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7852024-09-05T00:40:58.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 823.423292ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7862024-09-05T00:40:58.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 599.277087ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7872024-09-05T00:40:58.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 548.061757ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7882024-09-05T00:40:58.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 780.706993ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7892024-09-05T00:40:58.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60") failed: Property not found. retry in 1.321305567s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
7902024-09-05T00:40:58.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 1.141950019s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7912024-09-05T00:40:58.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 1.058565667s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7922024-09-05T00:40:59.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a") failed: Property not found. retry in 1.066038712s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
7932024-09-05T00:40:59.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 1.28352472s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7942024-09-05T00:40:59.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 840.692544ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
7952024-09-05T00:40:59.968ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 721.742592ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
7962024-09-05T00:40:59.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 690.416379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7972024-09-05T00:41:00.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 837.19131ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
7982024-09-05T00:41:00.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 1.430141042s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
7992024-09-05T00:41:00.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 1.073246328s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
8002024-09-05T00:41:01.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 611.3126ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
8012024-09-05T00:41:01.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 1.224658839s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
8022024-09-05T00:41:02.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 1.089600959s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
8032024-09-05T00:41:02.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 1.429438346s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
8042024-09-05T00:41:03.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 1.29776797s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
8052024-09-05T00:41:03.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 682.425169ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
8062024-09-05T00:41:03.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 1.118403519s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
8072024-09-05T00:41:03.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 707.653156ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
8082024-09-05T00:41:04.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 501.074433ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
8092024-09-05T00:41:04.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 789.831352ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
8102024-09-05T00:41:04.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 1.173825773s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
8112024-09-05T00:41:04.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 989.316629ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
8122024-09-05T00:41:05.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 582.43223ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
8132024-09-05T00:41:05.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 1.296321382s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
8142024-09-05T00:41:05.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 1.111760131s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
8152024-09-05T00:41:06.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 666.585946ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
8162024-09-05T00:41:06.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 851.498475ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
8172024-09-05T00:41:07.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 844.318307ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
8182024-09-05T00:41:07.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 1.170972576s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
8192024-09-05T00:41:07.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 1.377018604s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
8202024-09-05T00:41:07.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 893.428499ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
8212024-09-05T00:41:08.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab") failed: Property not found. retry in 1.104244104s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
8222024-09-05T00:41:08.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a") failed: Property not found. retry in 568.505138ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
8232024-09-05T00:41:08.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131") failed: Property not found. retry in 959.454322ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
8242024-09-05T00:41:09.970ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_cockroachdb_d0c615c8-bdeb-49a0-816f-a566dcc3c131
8252024-09-05T00:41:09.970ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_cockroachdb_7e3770ec-e483-41f5-acee-387c91143c60
8262024-09-05T00:41:09.970ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_cockroachdb_88e1f7e1-054c-4757-a614-b8a4dd3daa0a
8272024-09-05T00:41:09.970ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_cockroachdb_c91c6de7-fb5b-415a-adfd-671600a2a2ab
8282024-09-05T00:41:09.970ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_cockroachdb_a82c21c2-881c-4e81-ac17-f918e403fe8a
8292024-09-05T00:41:09.970ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8302024-09-05T00:41:09.970ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8312024-09-05T00:41:09.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 24312166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35557 req_id = a231345e-284e-4772-a299-5a6458e8f437 response_code = 204 uri = /omicron-zones
8322024-09-05T00:41:10.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40224
8332024-09-05T00:41:10.038ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3662
8342024-09-05T00:41:10.233ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3680
8352024-09-05T00:41:32.749ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3703
8362024-09-05T00:41:32.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 22743685 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40224 req_id = e02d7f73-417d-48cb-b721-5e76ebd564d4 response_code = 204 uri = /cockroachdb
8372024-09-05T00:41:32.753ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42070
8382024-09-05T00:41:32.754ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1210 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42070 req_id = aa9f5393-38c4-41a6-9f81-31f7f7491bed response_code = 200 uri = /baseboard
8392024-09-05T00:41:32.760ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 966.264053ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
8402024-09-05T00:41:32.796ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 89145bfe-85a8-47ae-9826-e73f4757fe92, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 12515ac3-ec02-4a77-94ca-e3454dcd9f1e, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 6ddad7d1-6368-48d2-afbc-48d82c861e83, kind: Service { id: 12515ac3-ec02-4a77-94ca-e3454dcd9f1e }, name: Name("ntp-12515ac3-ec02-4a77-94ca-e3454dcd9f1e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 205])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: d0c615c8-bdeb-49a0-816f-a566dcc3c131, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External } } } }, OmicronZoneConfig { id: a82c21c2-881c-4e81-ac17-f918e403fe8a, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External } } } }, OmicronZoneConfig { id: 7e3770ec-e483-41f5-acee-387c91143c60, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External } } } }, OmicronZoneConfig { id: 88e1f7e1-054c-4757-a614-b8a4dd3daa0a, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External } } } }, OmicronZoneConfig { id: c91c6de7-fb5b-415a-adfd-671600a2a2ab, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External } } } }, OmicronZoneConfig { id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b, underlay_address: fd00:1122:3344:101::8, filesystem_pool: Some(ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 60a23721-fd77-4d33-a0a4-0735bb775681, kind: Service { id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b }, name: Name("external-dns-4aa18504-a7e8-4aa1-94fe-a65abab62a4b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 145d6d08-bb1c-4557-af3d-b3b8e647b114, underlay_address: fd00:1122:3344:101::9, filesystem_pool: Some(ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 4201fb72-62c9-4bc9-b4fd-ee3284095ee8, kind: Service { id: 145d6d08-bb1c-4557-af3d-b3b8e647b114 }, name: Name("external-dns-145d6d08-bb1c-4557-af3d-b3b8e647b114"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 139])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 7171adea-be80-48c5-a65b-fe3a55b4870d, underlay_address: fd00:1122:3344:101::a, filesystem_pool: Some(ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 9f0144bd-0194-4864-a015-629f3aebd42c, kind: Service { id: 7171adea-be80-48c5-a65b-fe3a55b4870d }, name: Name("nexus-7171adea-be80-48c5-a65b-fe3a55b4870d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 5f1fb376-349f-4b39-808a-5aa5abc60b1e, underlay_address: fd00:1122:3344:101::b, filesystem_pool: Some(ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: fc066fb6-a099-4780-b3f0-61b984118b4f, kind: Service { id: 5f1fb376-349f-4b39-808a-5aa5abc60b1e }, name: Name("nexus-5f1fb376-349f-4b39-808a-5aa5abc60b1e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 225])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: c8b7e56a-4fd1-4100-8ded-5a17ea178a46, underlay_address: fd00:1122:3344:101::c, filesystem_pool: Some(ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 03971845-77e2-4239-964a-04e9c3f9d11e, kind: Service { id: c8b7e56a-4fd1-4100-8ded-5a17ea178a46 }, name: Name("nexus-c8b7e56a-4fd1-4100-8ded-5a17ea178a46"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 19d1dcd9-c605-423b-803d-56a986947027, underlay_address: fd00:1122:3344:101::d, filesystem_pool: Some(ZpoolName { id: 18c638cc-0eb0-43bd-9ec4-4ccc7a05322e (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f, underlay_address: fd00:1122:3344:101::e, filesystem_pool: Some(ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External } } } }, OmicronZoneConfig { id: 69311403-3792-46ef-887d-99994caeb32e, underlay_address: fd00:1122:3344:101::f, filesystem_pool: Some(ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 17177985-1bf4-4791-b114-8df9b15668dd, underlay_address: fd00:1122:3344:101::10, filesystem_pool: Some(ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 86c1fd8e-cd6c-48be-a19b-71d584272d48, underlay_address: fd00:1122:3344:101::11, filesystem_pool: Some(ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 37574d1d-8666-494d-9105-095f4f3a572d, underlay_address: fd00:1122:3344:101::12, filesystem_pool: Some(ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External } } } }, OmicronZoneConfig { id: cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2, underlay_address: fd00:1122:3344:101::13, filesystem_pool: Some(ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External } } } }, OmicronZoneConfig { id: ba398f64-a1fa-4409-b695-7cb384241284, underlay_address: fd00:1122:3344:101::14, filesystem_pool: Some(ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External } } } }, OmicronZoneConfig { id: 2f17e7e7-64f2-4af1-a2c5-a8288deebebe, underlay_address: fd00:1122:3344:101::15, filesystem_pool: Some(ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e, underlay_address: fd00:1122:3344:101::16, filesystem_pool: Some(ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External } } } }, OmicronZoneConfig { id: b137109e-22bc-49b0-bb4b-a04bc6f3ef81, underlay_address: fd00:1122:3344:101::17, filesystem_pool: Some(ZpoolName { id: 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8d016a7d-8807-43bd-a371-c6c811de8d5f, underlay_address: fd00:1122:3344:101::18, filesystem_pool: Some(ZpoolName { id: 3b890830-afe5-4534-9d63-2368c96a17b2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3b890830-afe5-4534-9d63-2368c96a17b2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 90398b44-8c65-4385-b2a0-927f107fae01, underlay_address: fd00:1122:3344:101::19, filesystem_pool: Some(ZpoolName { id: f4d0c62d-ea23-4f6c-a7fd-af646b395599 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f4d0c62d-ea23-4f6c-a7fd-af646b395599 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2d7bafea-257e-4f99-bb9d-4d921ef2a3b6, underlay_address: fd00:1122:3344:101::1a, filesystem_pool: Some(ZpoolName { id: 18c638cc-0eb0-43bd-9ec4-4ccc7a05322e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 18c638cc-0eb0-43bd-9ec4-4ccc7a05322e (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
8412024-09-05T00:41:32.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39268
8422024-09-05T00:41:32.798ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8432024-09-05T00:41:32.798ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 972980d1-78ce-4b3e-8b23-36e1a0e30ffb, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: InternalDns }, responder: ... }
8442024-09-05T00:41:32.824ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 89145bfe-85a8-47ae-9826-e73f4757fe92, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8452024-09-05T00:41:32.824ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 89145bfe-85a8-47ae-9826-e73f4757fe92, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: InternalDns }, responder: ... }
8462024-09-05T00:41:32.843ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8472024-09-05T00:41:32.843ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 0c51ae87-cbaf-4403-8e7a-91ae1f6a480f, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: InternalDns }, responder: ... }
8482024-09-05T00:41:32.862ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d0c615c8-bdeb-49a0-816f-a566dcc3c131, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8492024-09-05T00:41:32.862ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: d0c615c8-bdeb-49a0-816f-a566dcc3c131, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: Cockroach }, responder: ... }
8502024-09-05T00:41:32.881ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a82c21c2-881c-4e81-ac17-f918e403fe8a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8512024-09-05T00:41:32.881ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: a82c21c2-881c-4e81-ac17-f918e403fe8a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: Cockroach }, responder: ... }
8522024-09-05T00:41:32.898ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7e3770ec-e483-41f5-acee-387c91143c60, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8532024-09-05T00:41:32.898ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 7e3770ec-e483-41f5-acee-387c91143c60, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: Cockroach }, responder: ... }
8542024-09-05T00:41:32.916ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 88e1f7e1-054c-4757-a614-b8a4dd3daa0a, dataset_name: DatasetName { pool_name: ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8552024-09-05T00:41:32.917ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 88e1f7e1-054c-4757-a614-b8a4dd3daa0a, dataset_name: DatasetName { pool_name: ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8562024-09-05T00:41:32.935ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c91c6de7-fb5b-415a-adfd-671600a2a2ab, dataset_name: DatasetName { pool_name: ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8572024-09-05T00:41:32.935ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: c91c6de7-fb5b-415a-adfd-671600a2a2ab, dataset_name: DatasetName { pool_name: ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }, kind: Cockroach }, responder: ... }
8582024-09-05T00:41:32.953ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8592024-09-05T00:41:32.953ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8602024-09-05T00:41:33.067ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 145d6d08-bb1c-4557-af3d-b3b8e647b114, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8612024-09-05T00:41:33.067ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 145d6d08-bb1c-4557-af3d-b3b8e647b114, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8622024-09-05T00:41:33.215ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:451
8632024-09-05T00:41:33.215ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: Clickhouse }, responder: ... }
8642024-09-05T00:41:33.403ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 37574d1d-8666-494d-9105-095f4f3a572d, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8652024-09-05T00:41:33.403ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 37574d1d-8666-494d-9105-095f4f3a572d, dataset_name: DatasetName { pool_name: ZpoolName { id: 07758950-4365-4426-bdcd-a3906ef0719c (zpool), kind: External }, kind: Crucible }, responder: ... }
8662024-09-05T00:41:33.615ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8672024-09-05T00:41:33.615ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 3149c6f5-adf9-4e42-9a6f-ea817157070d (zpool), kind: External }, kind: Crucible }, responder: ... }
8682024-09-05T00:41:33.752ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ba398f64-a1fa-4409-b695-7cb384241284, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8692024-09-05T00:41:33.752ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: ba398f64-a1fa-4409-b695-7cb384241284, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f9ab94-cb52-4abd-b519-311e83310dbb (zpool), kind: External }, kind: Crucible }, responder: ... }
8702024-09-05T00:41:33.857ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f17e7e7-64f2-4af1-a2c5-a8288deebebe, dataset_name: DatasetName { pool_name: ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8712024-09-05T00:41:33.857ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 2f17e7e7-64f2-4af1-a2c5-a8288deebebe, dataset_name: DatasetName { pool_name: ZpoolName { id: cd6b3ed7-21c7-4782-a335-8ab89ee4c355 (zpool), kind: External }, kind: Crucible }, responder: ... }
8722024-09-05T00:41:33.973ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e, dataset_name: DatasetName { pool_name: ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8732024-09-05T00:41:33.973ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e, dataset_name: DatasetName { pool_name: ZpoolName { id: 5e93ddc1-113d-4d72-b455-60d0ee285e5b (zpool), kind: External }, kind: Crucible }, responder: ... }
8742024-09-05T00:41:34.072ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b137109e-22bc-49b0-bb4b-a04bc6f3ef81, dataset_name: DatasetName { pool_name: ZpoolName { id: 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8752024-09-05T00:41:34.072ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: b137109e-22bc-49b0-bb4b-a04bc6f3ef81, dataset_name: DatasetName { pool_name: ZpoolName { id: 0992886b-7bd4-4261-afe1-662fbe130da8 (zpool), kind: External }, kind: Crucible }, responder: ... }
8762024-09-05T00:41:34.178ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8d016a7d-8807-43bd-a371-c6c811de8d5f, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b890830-afe5-4534-9d63-2368c96a17b2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8772024-09-05T00:41:34.178ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 8d016a7d-8807-43bd-a371-c6c811de8d5f, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b890830-afe5-4534-9d63-2368c96a17b2 (zpool), kind: External }, kind: Crucible }, responder: ... }
8782024-09-05T00:41:34.312ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 90398b44-8c65-4385-b2a0-927f107fae01, dataset_name: DatasetName { pool_name: ZpoolName { id: f4d0c62d-ea23-4f6c-a7fd-af646b395599 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8792024-09-05T00:41:34.312ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 90398b44-8c65-4385-b2a0-927f107fae01, dataset_name: DatasetName { pool_name: ZpoolName { id: f4d0c62d-ea23-4f6c-a7fd-af646b395599 (zpool), kind: External }, kind: Crucible }, responder: ... }
8802024-09-05T00:41:34.432ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2d7bafea-257e-4f99-bb9d-4d921ef2a3b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 18c638cc-0eb0-43bd-9ec4-4ccc7a05322e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
8812024-09-05T00:41:34.432ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 2d7bafea-257e-4f99-bb9d-4d921ef2a3b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 18c638cc-0eb0-43bd-9ec4-4ccc7a05322e (zpool), kind: External }, kind: Crucible }, responder: ... }
8822024-09-05T00:41:34.566ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8832024-09-05T00:41:34.566ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/omicron-zones.json file = common/src/ledger.rs:177
8842024-09-05T00:41:34.567ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/omicron-zones.json file = common/src/ledger.rs:177
8852024-09-05T00:41:34.567ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8862024-09-05T00:41:34.725ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
8872024-09-05T00:41:34.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8882024-09-05T00:41:34.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8892024-09-05T00:41:34.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8902024-09-05T00:41:34.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8912024-09-05T00:41:34.738ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
8922024-09-05T00:41:34.761ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
8932024-09-05T00:41:34.761ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8942024-09-05T00:41:34.761ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8952024-09-05T00:41:34.763ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
8962024-09-05T00:41:34.885ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
8972024-09-05T00:41:34.933ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8982024-09-05T00:41:34.933ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8992024-09-05T00:41:34.933ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9002024-09-05T00:41:34.933ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9012024-09-05T00:41:34.933ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9022024-09-05T00:41:34.933ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9032024-09-05T00:41:34.933ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9042024-09-05T00:41:34.933ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9052024-09-05T00:41:34.933ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f file = illumos-utils/src/zone.rs:316
9062024-09-05T00:41:34.939ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d file = illumos-utils/src/zone.rs:316
9072024-09-05T00:41:34.944ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01 file = illumos-utils/src/zone.rs:316
9082024-09-05T00:41:34.949ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe file = illumos-utils/src/zone.rs:316
9092024-09-05T00:41:34.955ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2 file = illumos-utils/src/zone.rs:316
9102024-09-05T00:41:34.960ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6 file = illumos-utils/src/zone.rs:316
9112024-09-05T00:41:35.118ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f file = illumos-utils/src/zone.rs:354
9122024-09-05T00:41:35.122ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d file = illumos-utils/src/zone.rs:354
9132024-09-05T00:41:35.127ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01 file = illumos-utils/src/zone.rs:354
9142024-09-05T00:41:35.132ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe file = illumos-utils/src/zone.rs:354
9152024-09-05T00:41:35.136ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2 file = illumos-utils/src/zone.rs:354
9162024-09-05T00:41:35.141ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6 file = illumos-utils/src/zone.rs:354
9172024-09-05T00:41:35.146ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027 file = illumos-utils/src/zone.rs:316
9182024-09-05T00:41:35.151ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48 file = illumos-utils/src/zone.rs:316
9192024-09-05T00:41:35.156ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284 file = illumos-utils/src/zone.rs:316
9202024-09-05T00:41:35.161ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e file = illumos-utils/src/zone.rs:316
9212024-09-05T00:41:35.165ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f file = illumos-utils/src/zone.rs:316
9222024-09-05T00:41:35.171ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e file = illumos-utils/src/zone.rs:316
9232024-09-05T00:41:35.176ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd file = illumos-utils/src/zone.rs:316
9242024-09-05T00:41:35.182ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81 file = illumos-utils/src/zone.rs:316
9252024-09-05T00:41:35.225ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9262024-09-05T00:41:35.257ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9272024-09-05T00:41:35.294ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9282024-09-05T00:41:35.294ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027 file = illumos-utils/src/zone.rs:354
9292024-09-05T00:41:35.302ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48 file = illumos-utils/src/zone.rs:354
9302024-09-05T00:41:35.308ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284 file = illumos-utils/src/zone.rs:354
9312024-09-05T00:41:35.314ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e file = illumos-utils/src/zone.rs:354
9322024-09-05T00:41:35.321ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f file = illumos-utils/src/zone.rs:354
9332024-09-05T00:41:35.329ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e file = illumos-utils/src/zone.rs:354
9342024-09-05T00:41:35.337ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd file = illumos-utils/src/zone.rs:354
9352024-09-05T00:41:35.344ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81 file = illumos-utils/src/zone.rs:354
9362024-09-05T00:41:35.414ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9372024-09-05T00:41:35.421ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9382024-09-05T00:41:35.421ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9392024-09-05T00:41:35.493ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 166, 225]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9402024-09-05T00:41:35.493ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = nexus
9412024-09-05T00:41:35.495ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9422024-09-05T00:41:35.495ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9432024-09-05T00:41:35.536ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 208, 139]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
9442024-09-05T00:41:35.536ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = external_dns
9452024-09-05T00:41:35.537ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9462024-09-05T00:41:35.537ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9472024-09-05T00:41:35.581ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 161, 248]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9482024-09-05T00:41:35.581ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = nexus
9492024-09-05T00:41:35.583ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9502024-09-05T00:41:35.583ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9512024-09-05T00:41:35.640ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 170, 220]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9522024-09-05T00:41:35.640ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = nexus
9532024-09-05T00:41:35.722ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9542024-09-05T00:41:35.727ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9552024-09-05T00:41:35.727ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9562024-09-05T00:41:35.779ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 242, 90]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
9572024-09-05T00:41:35.779ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = external_dns
9582024-09-05T00:41:35.779ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
9592024-09-05T00:41:35.779ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
9602024-09-05T00:41:35.779ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
9612024-09-05T00:41:35.779ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
9622024-09-05T00:41:35.779ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
9632024-09-05T00:41:35.779ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
9642024-09-05T00:41:35.780ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
9652024-09-05T00:41:35.780ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
9662024-09-05T00:41:35.788ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
9672024-09-05T00:41:35.790ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9682024-09-05T00:41:35.829ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
9692024-09-05T00:41:35.833ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
9702024-09-05T00:41:35.836ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9712024-09-05T00:41:35.836ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9722024-09-05T00:41:35.836ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
9732024-09-05T00:41:35.839ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9742024-09-05T00:41:35.839ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
9752024-09-05T00:41:35.839ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
9762024-09-05T00:41:35.963ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
9772024-09-05T00:41:35.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9782024-09-05T00:41:35.966ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e file = illumos-utils/src/zone.rs:316
9792024-09-05T00:41:35.976ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114 file = illumos-utils/src/zone.rs:316
9802024-09-05T00:41:35.986ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d file = illumos-utils/src/zone.rs:316
9812024-09-05T00:41:35.995ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46 file = illumos-utils/src/zone.rs:316
9822024-09-05T00:41:36.042ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e file = illumos-utils/src/zone.rs:354
9832024-09-05T00:41:36.050ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114 file = illumos-utils/src/zone.rs:354
9842024-09-05T00:41:36.061ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d file = illumos-utils/src/zone.rs:354
9852024-09-05T00:41:36.076ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46 file = illumos-utils/src/zone.rs:354
9862024-09-05T00:41:36.092ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b file = illumos-utils/src/zone.rs:316
9872024-09-05T00:41:36.132ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b file = illumos-utils/src/zone.rs:354
9882024-09-05T00:41:38.636ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3b890830-afe5-4534-9d63-2368c96a17b2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e218ec6e-1687-4e56-8247-3d54f7afd313'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9892024-09-05T00:41:38.636ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0992886b-7bd4-4261-afe1-662fbe130da8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='061278e8-b76e-46fe-9a18-8646b8cf013b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9902024-09-05T00:41:38.637ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
9912024-09-05T00:41:38.644ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f4d0c62d-ea23-4f6c-a7fd-af646b395599/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='deb712be-de66-4f1c-a553-729e5560f89a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9922024-09-05T00:41:38.644ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cd6b3ed7-21c7-4782-a335-8ab89ee4c355/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a063e99d-55fd-4e1d-8475-cd1939973907'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9932024-09-05T00:41:38.645ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3149c6f5-adf9-4e42-9a6f-ea817157070d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fde4653b-e06f-4c86-a752-72ae1252356d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9942024-09-05T00:41:38.645ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
9952024-09-05T00:41:38.651ZINFOSledAgent (ServiceManager): Booting oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
9962024-09-05T00:41:38.658ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
9972024-09-05T00:41:38.663ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
9982024-09-05T00:41:38.670ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_18c638cc-0eb0-43bd-9ec4-4ccc7a05322e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4bb7a37f-e8af-42c5-ae68-63f7a6381383'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9992024-09-05T00:41:38.670ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_47f9ab94-cb52-4abd-b519-311e83310dbb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0d519709-13c8-4f19-ba58-3d57ae15666b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10002024-09-05T00:41:38.670ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
10012024-09-05T00:41:38.676ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
10022024-09-05T00:41:38.690ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='19d1dcd9-c605-423b-803d-56a986947027'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10032024-09-05T00:41:38.690ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
10042024-09-05T00:41:39.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 35.052343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
10052024-09-05T00:41:39.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 65.355479ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
10062024-09-05T00:41:39.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 44.40888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
10072024-09-05T00:41:39.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 66.942171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
10082024-09-05T00:41:39.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 52.364306ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
10092024-09-05T00:41:39.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 44.189062ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
10102024-09-05T00:41:39.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 117.668694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
10112024-09-05T00:41:39.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 147.503152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
10122024-09-05T00:41:39.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 85.405702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
10132024-09-05T00:41:40.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 134.682461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
10142024-09-05T00:41:40.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 36.387764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
10152024-09-05T00:41:40.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 94.133327ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
10162024-09-05T00:41:40.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 71.906426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
10172024-09-05T00:41:40.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 134.881908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
10182024-09-05T00:41:40.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 149.580151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
10192024-09-05T00:41:40.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 106.440183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
10202024-09-05T00:41:40.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 296.206047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
10212024-09-05T00:41:40.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 133.639331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
10222024-09-05T00:41:40.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 146.233336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
10232024-09-05T00:41:40.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 287.462067ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
10242024-09-05T00:41:40.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 86.50144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
10252024-09-05T00:41:41.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 174.7805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
10262024-09-05T00:41:41.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 255.257803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
10272024-09-05T00:41:41.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 465.460515ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
10282024-09-05T00:41:41.034ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5e93ddc1-113d-4d72-b455-60d0ee285e5b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='85cf80b2-b4a1-471c-a8ac-dcc1014f135a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10292024-09-05T00:41:41.034ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
10302024-09-05T00:41:41.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 196.956127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
10312024-09-05T00:41:41.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 383.670153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
10322024-09-05T00:41:41.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 223.092623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
10332024-09-05T00:41:41.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 476.350098ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
10342024-09-05T00:41:41.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 583.517521ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
10352024-09-05T00:41:41.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 586.471805ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
10362024-09-05T00:41:41.248ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10372024-09-05T00:41:41.248ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10382024-09-05T00:41:41.248ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
10392024-09-05T00:41:41.256ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
10402024-09-05T00:41:41.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 505.013849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
10412024-09-05T00:41:41.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 762.872809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
10422024-09-05T00:41:41.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 32.201087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
10432024-09-05T00:41:41.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 347.42266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
10442024-09-05T00:41:41.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 83.306269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
10452024-09-05T00:41:41.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 184.003845ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
10462024-09-05T00:41:41.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.001936087s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
10472024-09-05T00:41:41.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 544.951402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
10482024-09-05T00:41:41.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 70.747889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
10492024-09-05T00:41:41.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 43.576935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
10502024-09-05T00:41:41.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 126.448492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
10512024-09-05T00:41:41.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 109.393522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
10522024-09-05T00:41:41.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 417.319384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
10532024-09-05T00:41:41.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.185459855s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
10542024-09-05T00:41:41.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.054594782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
10552024-09-05T00:41:41.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 297.738324ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
10562024-09-05T00:41:41.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 182.913224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
10572024-09-05T00:41:41.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 865.584527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
10582024-09-05T00:41:41.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 857.646987ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
10592024-09-05T00:41:41.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 812.078364ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
10602024-09-05T00:41:41.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 522.92241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
10612024-09-05T00:41:42.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 792.167062ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
10622024-09-05T00:41:42.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 527.727903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
10632024-09-05T00:41:42.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 657.153849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
10642024-09-05T00:41:42.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 662.920317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
10652024-09-05T00:41:42.115ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10662024-09-05T00:41:42.115ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
10672024-09-05T00:41:42.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 71.425747ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
10682024-09-05T00:41:42.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.221201715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
10692024-09-05T00:41:42.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 439.458455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
10702024-09-05T00:41:42.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 145.255694ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
10712024-09-05T00:41:42.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 815.300149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
10722024-09-05T00:41:42.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 984.147557ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
10732024-09-05T00:41:42.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 614.415098ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
10742024-09-05T00:41:42.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.073496147s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
10752024-09-05T00:41:42.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 172.885454ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
10762024-09-05T00:41:42.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.274162663s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
10772024-09-05T00:41:42.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.323189172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
10782024-09-05T00:41:42.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 631.814404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
10792024-09-05T00:41:42.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.062015143s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
10802024-09-05T00:41:42.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.274186399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
10812024-09-05T00:41:42.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 308.532122ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
10822024-09-05T00:41:42.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 719.36386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
10832024-09-05T00:41:43.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.142774419s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
10842024-09-05T00:41:43.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 787.724771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
10852024-09-05T00:41:43.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.481295992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
10862024-09-05T00:41:43.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 521.748237ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
10872024-09-05T00:41:43.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.381504679s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
10882024-09-05T00:41:43.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.249370702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
10892024-09-05T00:41:43.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 679.820023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
10902024-09-05T00:41:43.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.238686222s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
10912024-09-05T00:41:43.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 932.141807ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
10922024-09-05T00:41:43.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 553.257772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
10932024-09-05T00:41:44.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 642.185806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
10942024-09-05T00:41:44.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 812.706514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
10952024-09-05T00:41:44.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 771.028103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
10962024-09-05T00:41:44.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.104062012s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
10972024-09-05T00:41:44.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.227037965s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
10982024-09-05T00:41:44.385ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10992024-09-05T00:41:44.386ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11002024-09-05T00:41:44.386ZINFOSledAgent (ServiceManager): Booting oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
11012024-09-05T00:41:44.390ZINFOSledAgent (ServiceManager): Booting oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
11022024-09-05T00:41:44.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.156753933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
11032024-09-05T00:41:44.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.417948664s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
11042024-09-05T00:41:44.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 53.708578ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
11052024-09-05T00:41:44.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 32.851197ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
11062024-09-05T00:41:44.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 129.787128ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
11072024-09-05T00:41:44.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 129.833952ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
11082024-09-05T00:41:44.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.112787639s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
11092024-09-05T00:41:44.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 142.495188ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
11102024-09-05T00:41:44.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 135.463677ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
11112024-09-05T00:41:44.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 685.043614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
11122024-09-05T00:41:44.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 919.763252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
11132024-09-05T00:41:44.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.382010376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
11142024-09-05T00:41:44.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.19271234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
11152024-09-05T00:41:44.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 391.504649ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
11162024-09-05T00:41:44.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 291.855934ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
11172024-09-05T00:41:44.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.098530195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
11182024-09-05T00:41:45.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.495952789s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
11192024-09-05T00:41:45.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.285718811s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
11202024-09-05T00:41:45.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 961.978152ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
11212024-09-05T00:41:45.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 807.573389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
11222024-09-05T00:41:45.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 1.193536742s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
11232024-09-05T00:41:45.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 814.664306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
11242024-09-05T00:41:45.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.038400309s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
11252024-09-05T00:41:45.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.044561759s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
11262024-09-05T00:41:45.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 792.680962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
11272024-09-05T00:41:45.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.270177802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
11282024-09-05T00:41:45.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.181968512s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
11292024-09-05T00:41:46.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 654.020867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
11302024-09-05T00:41:46.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.228560516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
11312024-09-05T00:41:46.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.165503321s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
11322024-09-05T00:41:46.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.158985036s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
11332024-09-05T00:41:46.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 961.876385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
11342024-09-05T00:41:46.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.40944094s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
11352024-09-05T00:41:46.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.490177674s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
11362024-09-05T00:41:46.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.295735502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
11372024-09-05T00:41:46.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 566.252186ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
11382024-09-05T00:41:46.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 815.706475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
11392024-09-05T00:41:46.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.151773413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
11402024-09-05T00:41:46.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 911.193564ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
11412024-09-05T00:41:46.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.062365823s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
11422024-09-05T00:41:47.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.047100424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
11432024-09-05T00:41:47.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 639.746214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
11442024-09-05T00:41:47.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 749.670417ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
11452024-09-05T00:41:47.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.239197399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
11462024-09-05T00:41:47.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 830.994123ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
11472024-09-05T00:41:47.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.289355707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
11482024-09-05T00:41:47.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.063255945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
11492024-09-05T00:41:47.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.130869084s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
11502024-09-05T00:41:47.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.449417621s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
11512024-09-05T00:41:47.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.280415079s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
11522024-09-05T00:41:47.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.288247347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
11532024-09-05T00:41:47.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 588.640809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
11542024-09-05T00:41:47.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 857.789464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
11552024-09-05T00:41:47.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.49610515s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
11562024-09-05T00:41:48.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.467642633s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
11572024-09-05T00:41:48.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 587.471845ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
11582024-09-05T00:41:48.404ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11592024-09-05T00:41:48.404ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
11602024-09-05T00:41:48.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.037965318s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
11612024-09-05T00:41:48.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 592.144136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
11622024-09-05T00:41:48.450ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11632024-09-05T00:41:48.450ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
11642024-09-05T00:41:48.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.447925511s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
11652024-09-05T00:41:48.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 654.414147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
11662024-09-05T00:41:48.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 520.156625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
11672024-09-05T00:41:48.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 42.221011ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
11682024-09-05T00:41:48.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 70.723454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
11692024-09-05T00:41:48.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 937.925365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
11702024-09-05T00:41:48.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 88.019266ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
11712024-09-05T00:41:48.854ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.81671803s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
11722024-09-05T00:41:48.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 776.543959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
11732024-09-05T00:41:48.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 84.445854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
11742024-09-05T00:41:48.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 510.420964ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
11752024-09-05T00:41:48.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 930.390583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
11762024-09-05T00:41:48.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 275.786598ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
11772024-09-05T00:41:48.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 131.679292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
11782024-09-05T00:41:49.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.395961464s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
11792024-09-05T00:41:49.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.210213412s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
11802024-09-05T00:41:49.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 861.573233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
11812024-09-05T00:41:49.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.488593955s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
11822024-09-05T00:41:49.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 430.518328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
11832024-09-05T00:41:49.207ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_07758950-4365-4426-bdcd-a3906ef0719c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='25632a0f-8539-4506-b846-8b6f87902952'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11842024-09-05T00:41:49.207ZINFOSledAgent (ServiceManager): Booting oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
11852024-09-05T00:41:49.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 490.528611ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
11862024-09-05T00:41:49.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 655.378283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
11872024-09-05T00:41:49.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.262040658s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
11882024-09-05T00:41:49.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 1.19522552s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
11892024-09-05T00:41:49.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.210807777s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
11902024-09-05T00:41:49.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 47.294549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
11912024-09-05T00:41:49.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.357998803s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
11922024-09-05T00:41:49.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 56.65378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
11932024-09-05T00:41:49.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 1.194894927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
11942024-09-05T00:41:49.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 213.442104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
11952024-09-05T00:41:49.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 693.575294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
11962024-09-05T00:41:49.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.031762031s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
11972024-09-05T00:41:49.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 702.463698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
11982024-09-05T00:41:49.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 496.678433ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
11992024-09-05T00:41:49.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 264.690565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
12002024-09-05T00:41:49.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.26119689s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
12012024-09-05T00:41:49.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.303958632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
12022024-09-05T00:41:49.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.218209989s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
12032024-09-05T00:41:49.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 956.274666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
12042024-09-05T00:41:50.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 491.782609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
12052024-09-05T00:41:50.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.483510692s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
12062024-09-05T00:41:50.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 903.188152ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
12072024-09-05T00:41:50.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.030443741s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
12082024-09-05T00:41:50.374ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12092024-09-05T00:41:50.374ZINFOSledAgent (ServiceManager): Booting oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
12102024-09-05T00:41:50.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 717.56579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
12112024-09-05T00:41:50.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 552.517523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
12122024-09-05T00:41:50.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 35.673782ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
12132024-09-05T00:41:50.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 141.81684ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
12142024-09-05T00:41:50.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 1.303732147s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
12152024-09-05T00:41:50.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 898.310311ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
12162024-09-05T00:41:50.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.248900466s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
12172024-09-05T00:41:50.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.11919244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
12182024-09-05T00:41:50.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 542.43243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
12192024-09-05T00:41:50.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.423927205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
12202024-09-05T00:41:50.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 263.880314ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
12212024-09-05T00:41:50.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 1.376392839s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
12222024-09-05T00:41:50.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 871.550076ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
12232024-09-05T00:41:50.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 569.122525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
12242024-09-05T00:41:50.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 239.493926ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
12252024-09-05T00:41:51.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 793.024999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
12262024-09-05T00:41:51.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 607.278007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
12272024-09-05T00:41:51.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 975.951476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
12282024-09-05T00:41:51.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 916.54177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
12292024-09-05T00:41:51.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.30960432s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
12302024-09-05T00:41:51.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.303026107s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
12312024-09-05T00:41:51.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 512.684769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
12322024-09-05T00:41:51.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 595.649721ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
12332024-09-05T00:41:51.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 949.709004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
12342024-09-05T00:41:51.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 970.906371ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
12352024-09-05T00:41:51.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.139431876s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
12362024-09-05T00:41:51.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.245199987s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
12372024-09-05T00:41:51.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.279323364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
12382024-09-05T00:41:51.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 670.579343ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
12392024-09-05T00:41:51.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.080666661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
12402024-09-05T00:41:51.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 742.267044ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
12412024-09-05T00:41:51.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.41396877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
12422024-09-05T00:41:51.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.088553607s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
12432024-09-05T00:41:51.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 644.957693ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
12442024-09-05T00:41:51.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 581.087793ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
12452024-09-05T00:41:52.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 886.465073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
12462024-09-05T00:41:52.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 597.310629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
12472024-09-05T00:41:52.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 507.749421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
12482024-09-05T00:41:52.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 1.481897949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
12492024-09-05T00:41:52.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 683.203531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
12502024-09-05T00:41:52.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.180848878s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
12512024-09-05T00:41:52.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 667.977087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
12522024-09-05T00:41:52.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 676.541274ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
12532024-09-05T00:41:52.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 701.378619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
12542024-09-05T00:41:52.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.304640625s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
12552024-09-05T00:41:52.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 568.942851ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
12562024-09-05T00:41:52.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.095774577s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
12572024-09-05T00:41:52.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 627.897361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
12582024-09-05T00:41:52.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.153614795s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
12592024-09-05T00:41:52.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 703.438749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
12602024-09-05T00:41:52.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.146318106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
12612024-09-05T00:41:52.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 534.219307ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
12622024-09-05T00:41:52.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 848.445697ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
12632024-09-05T00:41:53.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.027640347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
12642024-09-05T00:41:53.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 675.879667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
12652024-09-05T00:41:53.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.016719252s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
12662024-09-05T00:41:53.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.294342795s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
12672024-09-05T00:41:53.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 975.650275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
12682024-09-05T00:41:53.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 1.205136657s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
12692024-09-05T00:41:53.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 652.438764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
12702024-09-05T00:41:53.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.160745542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
12712024-09-05T00:41:53.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 954.721243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
12722024-09-05T00:41:53.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 855.631555ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
12732024-09-05T00:41:53.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 659.723738ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
12742024-09-05T00:41:53.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.182166375s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
12752024-09-05T00:41:53.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.019570911s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
12762024-09-05T00:41:53.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 1.128575302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
12772024-09-05T00:41:53.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 972.212751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
12782024-09-05T00:41:53.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.244542975s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
12792024-09-05T00:41:53.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.079019498s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
12802024-09-05T00:41:53.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 690.053324ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
12812024-09-05T00:41:53.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.36028854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
12822024-09-05T00:41:54.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.408460261s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
12832024-09-05T00:41:54.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.466268184s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
12842024-09-05T00:41:54.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.137817659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
12852024-09-05T00:41:54.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 809.178592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
12862024-09-05T00:41:54.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.124514826s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
12872024-09-05T00:41:54.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 934.436648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
12882024-09-05T00:41:54.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 832.461845ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
12892024-09-05T00:41:54.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 727.409233ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
12902024-09-05T00:41:54.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.496703536s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
12912024-09-05T00:41:54.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 636.479009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
12922024-09-05T00:41:54.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 990.915748ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
12932024-09-05T00:41:54.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.114180238s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
12942024-09-05T00:41:54.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.382670266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
12952024-09-05T00:41:54.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 987.587232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
12962024-09-05T00:41:54.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 731.204716ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
12972024-09-05T00:41:54.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 671.898942ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
12982024-09-05T00:41:54.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 568.108587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
12992024-09-05T00:41:55.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 702.834791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
13002024-09-05T00:41:55.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 581.95421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
13012024-09-05T00:41:55.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 998.199603ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
13022024-09-05T00:41:55.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.074973119s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
13032024-09-05T00:41:55.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 851.150389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
13042024-09-05T00:41:55.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.130383662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
13052024-09-05T00:41:55.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.025627893s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
13062024-09-05T00:41:55.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.197578807s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
13072024-09-05T00:41:55.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 699.316903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
13082024-09-05T00:41:55.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.403402651s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
13092024-09-05T00:41:55.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.317048717s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
13102024-09-05T00:41:55.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 1.077316983s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
13112024-09-05T00:41:55.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.115886873s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
13122024-09-05T00:41:55.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 671.007124ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
13132024-09-05T00:41:55.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.418765269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
13142024-09-05T00:41:55.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 610.114756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
13152024-09-05T00:41:55.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 907.300123ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
13162024-09-05T00:41:55.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 1.48950443s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
13172024-09-05T00:41:55.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 644.238987ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
13182024-09-05T00:41:56.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 785.188399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
13192024-09-05T00:41:56.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 853.983272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
13202024-09-05T00:41:56.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 983.301166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
13212024-09-05T00:41:56.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 604.2319ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
13222024-09-05T00:41:56.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 981.918043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
13232024-09-05T00:41:56.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 619.447238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
13242024-09-05T00:41:56.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.269796587s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
13252024-09-05T00:41:56.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.139095429s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
13262024-09-05T00:41:56.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 692.119471ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
13272024-09-05T00:41:56.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 688.80531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
13282024-09-05T00:41:56.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 834.19124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
13292024-09-05T00:41:56.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 720.988858ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
13302024-09-05T00:41:56.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.110766573s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
13312024-09-05T00:41:56.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 833.464919ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
13322024-09-05T00:41:56.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 1.005653384s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
13332024-09-05T00:41:56.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.448249951s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
13342024-09-05T00:41:56.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 707.568529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
13352024-09-05T00:41:56.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 761.974236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
13362024-09-05T00:41:56.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 807.45909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
13372024-09-05T00:41:57.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 593.839469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
13382024-09-05T00:41:57.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.300814368s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
13392024-09-05T00:41:57.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.364006214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
13402024-09-05T00:41:57.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 992.834341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
13412024-09-05T00:41:57.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 1.305328802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
13422024-09-05T00:41:57.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.461669032s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
13432024-09-05T00:41:57.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 792.660238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
13442024-09-05T00:41:57.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 934.921424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
13452024-09-05T00:41:57.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.048385618s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
13462024-09-05T00:41:57.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.245543005s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
13472024-09-05T00:41:57.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.095553362s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
13482024-09-05T00:41:57.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.365006907s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
13492024-09-05T00:41:57.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.388519591s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
13502024-09-05T00:41:57.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 704.564028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
13512024-09-05T00:41:57.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 807.024016ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
13522024-09-05T00:41:57.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.485942341s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
13532024-09-05T00:41:57.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 655.765196ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
13542024-09-05T00:41:57.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.426935928s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
13552024-09-05T00:41:58.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 931.094754ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
13562024-09-05T00:41:58.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 854.414219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
13572024-09-05T00:41:58.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 664.56811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
13582024-09-05T00:41:58.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 1.293958627s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
13592024-09-05T00:41:58.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.473921789s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
13602024-09-05T00:41:58.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.480685159s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
13612024-09-05T00:41:58.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 504.814812ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
13622024-09-05T00:41:58.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.226102666s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
13632024-09-05T00:41:58.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 911.005627ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
13642024-09-05T00:41:58.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 755.410394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
13652024-09-05T00:41:58.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 619.222483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
13662024-09-05T00:41:58.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.273002898s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
13672024-09-05T00:41:58.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.001687217s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
13682024-09-05T00:41:58.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.423719077s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
13692024-09-05T00:41:58.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 538.401527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
13702024-09-05T00:41:59.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.463051557s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
13712024-09-05T00:41:59.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.477008598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
13722024-09-05T00:41:59.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 726.025934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
13732024-09-05T00:41:59.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.225192511s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
13742024-09-05T00:41:59.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.353895988s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
13752024-09-05T00:41:59.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 1.192737817s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
13762024-09-05T00:41:59.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.115901919s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
13772024-09-05T00:41:59.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.009761278s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
13782024-09-05T00:41:59.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 596.856862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
13792024-09-05T00:41:59.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 1.462224646s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
13802024-09-05T00:41:59.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.421203515s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
13812024-09-05T00:41:59.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 713.627482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
13822024-09-05T00:41:59.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 672.115994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
13832024-09-05T00:41:59.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.081276907s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
13842024-09-05T00:41:59.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 500.517063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
13852024-09-05T00:41:59.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 910.424243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
13862024-09-05T00:41:59.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 839.108563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
13872024-09-05T00:41:59.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.109780422s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
13882024-09-05T00:41:59.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 713.323503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
13892024-09-05T00:42:00.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 575.371266ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
13902024-09-05T00:42:00.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 871.038626ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
13912024-09-05T00:42:00.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.105980576s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
13922024-09-05T00:42:00.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.057274081s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
13932024-09-05T00:42:00.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 594.279733ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
13942024-09-05T00:42:00.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 706.739548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
13952024-09-05T00:42:00.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 667.860321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
13962024-09-05T00:42:00.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.162438121s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
13972024-09-05T00:42:00.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.230493781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
13982024-09-05T00:42:00.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 819.366181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
13992024-09-05T00:42:00.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 515.581415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
14002024-09-05T00:42:00.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.021683496s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
14012024-09-05T00:42:00.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.090580763s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
14022024-09-05T00:42:00.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 623.167136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
14032024-09-05T00:42:00.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 827.026125ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
14042024-09-05T00:42:00.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.261225381s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
14052024-09-05T00:42:00.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 847.29337ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
14062024-09-05T00:42:00.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 1.240334323s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
14072024-09-05T00:42:01.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.437383149s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
14082024-09-05T00:42:01.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 552.390029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
14092024-09-05T00:42:01.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 793.735954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
14102024-09-05T00:42:01.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 726.754654ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
14112024-09-05T00:42:01.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 1.294089268s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
14122024-09-05T00:42:01.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 895.118111ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
14132024-09-05T00:42:01.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 655.006392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
14142024-09-05T00:42:01.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.408804971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
14152024-09-05T00:42:01.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.339301775s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
14162024-09-05T00:42:01.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 552.109498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
14172024-09-05T00:42:01.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 969.381608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
14182024-09-05T00:42:01.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 662.382141ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
14192024-09-05T00:42:01.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 517.221477ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
14202024-09-05T00:42:01.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 595.045101ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
14212024-09-05T00:42:01.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.16882396s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
14222024-09-05T00:42:01.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 997.250229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
14232024-09-05T00:42:01.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 865.239152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
14242024-09-05T00:42:01.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.014008063s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
14252024-09-05T00:42:01.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 750.739505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
14262024-09-05T00:42:02.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 600.7405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
14272024-09-05T00:42:02.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 936.583215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
14282024-09-05T00:42:02.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 722.921659ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
14292024-09-05T00:42:02.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.157166192s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
14302024-09-05T00:42:02.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 924.132802ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
14312024-09-05T00:42:02.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 1.333859748s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
14322024-09-05T00:42:02.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.328488358s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
14332024-09-05T00:42:02.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 924.797468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
14342024-09-05T00:42:02.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 1.326526758s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
14352024-09-05T00:42:02.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.059970011s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
14362024-09-05T00:42:02.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.038603426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
14372024-09-05T00:42:02.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.230180091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
14382024-09-05T00:42:02.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 804.887842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
14392024-09-05T00:42:02.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 1.483891864s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
14402024-09-05T00:42:02.800ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49259
14412024-09-05T00:42:02.809ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8893 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49259 req_id = cd7bcd06-0ab8-4582-9f7c-b43a53cff23f response_code = 200 uri = /baseboard
14422024-09-05T00:42:02.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 868.194717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
14432024-09-05T00:42:02.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 962.377269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
14442024-09-05T00:42:02.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.23568361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
14452024-09-05T00:42:02.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.295773815s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
14462024-09-05T00:42:02.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 997.910924ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
14472024-09-05T00:42:02.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 934.388888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
14482024-09-05T00:42:02.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.218432223s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
14492024-09-05T00:42:03.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 837.268355ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
14502024-09-05T00:42:03.269ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14512024-09-05T00:42:03.270ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
14522024-09-05T00:42:03.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.441237617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
14532024-09-05T00:42:03.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.301601667s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
14542024-09-05T00:42:03.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.319060731s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
14552024-09-05T00:42:03.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 56.802547ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
14562024-09-05T00:42:03.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.334038442s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
14572024-09-05T00:42:03.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 86.777166ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
14582024-09-05T00:42:03.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 922.152723ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
14592024-09-05T00:42:03.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 517.293372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
14602024-09-05T00:42:03.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.275606082s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
14612024-09-05T00:42:03.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.040345682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
14622024-09-05T00:42:03.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 254.882601ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
14632024-09-05T00:42:03.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 1.116234769s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
14642024-09-05T00:42:03.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.156816091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
14652024-09-05T00:42:03.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 977.192992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
14662024-09-05T00:42:03.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.287244745s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
14672024-09-05T00:42:03.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.043945805s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
14682024-09-05T00:42:04.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 985.562957ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
14692024-09-05T00:42:04.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 323.641896ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
14702024-09-05T00:42:04.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.32830531s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
14712024-09-05T00:42:04.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 713.843917ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
14722024-09-05T00:42:04.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.178374956s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
14732024-09-05T00:42:04.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 1.305410656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
14742024-09-05T00:42:04.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.481035299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
14752024-09-05T00:42:04.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 480.169808ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
14762024-09-05T00:42:04.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 1.198541104s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
14772024-09-05T00:42:04.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.16859701s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
14782024-09-05T00:42:04.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.323147908s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
14792024-09-05T00:42:04.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 732.492899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
14802024-09-05T00:42:04.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 556.853734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
14812024-09-05T00:42:04.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.107711682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
14822024-09-05T00:42:04.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 1.039304348s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
14832024-09-05T00:42:04.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.296834964s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
14842024-09-05T00:42:04.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 958.11856ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
14852024-09-05T00:42:04.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 1.281259436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
14862024-09-05T00:42:04.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.35148432s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
14872024-09-05T00:42:05.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.250285106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
14882024-09-05T00:42:05.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.071790485s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
14892024-09-05T00:42:05.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.205406173s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
14902024-09-05T00:42:05.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.053909264s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
14912024-09-05T00:42:05.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.476284777s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
14922024-09-05T00:42:05.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.42248035s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
14932024-09-05T00:42:05.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 830.172927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
14942024-09-05T00:42:05.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 1.315279982s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
14952024-09-05T00:42:05.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 868.022535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
14962024-09-05T00:42:05.712ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.989684927s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
14972024-09-05T00:42:05.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 781.962584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
14982024-09-05T00:42:05.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 676.950106ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
14992024-09-05T00:42:05.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 869.796334ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
15002024-09-05T00:42:05.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.428997813s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
15012024-09-05T00:42:05.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 1.324028803s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
15022024-09-05T00:42:05.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.24737494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
15032024-09-05T00:42:06.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.132259828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
15042024-09-05T00:42:06.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 724.787929ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
15052024-09-05T00:42:06.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.39693814s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
15062024-09-05T00:42:06.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 527.758023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
15072024-09-05T00:42:06.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.248436232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
15082024-09-05T00:42:06.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.004783903s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
15092024-09-05T00:42:06.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.038035967s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
15102024-09-05T00:42:06.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 669.219051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
15112024-09-05T00:42:06.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 959.602678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
15122024-09-05T00:42:06.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 824.630333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
15132024-09-05T00:42:06.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 818.261709ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
15142024-09-05T00:42:06.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 787.658049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
15152024-09-05T00:42:06.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.013789347s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
15162024-09-05T00:42:06.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 946.899837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
15172024-09-05T00:42:06.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 589.901822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
15182024-09-05T00:42:06.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 860.931962ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
15192024-09-05T00:42:06.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 1.400323207s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
15202024-09-05T00:42:06.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.490115975s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
15212024-09-05T00:42:06.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.181736615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
15222024-09-05T00:42:07.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 572.831509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
15232024-09-05T00:42:07.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 1.380554266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
15242024-09-05T00:42:07.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 1.056487224s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
15252024-09-05T00:42:07.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 1.406446318s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
15262024-09-05T00:42:07.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 804.180555ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
15272024-09-05T00:42:07.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 567.806111ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
15282024-09-05T00:42:07.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 804.87554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
15292024-09-05T00:42:07.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 940.13367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
15302024-09-05T00:42:07.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.046128819s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
15312024-09-05T00:42:07.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.070000335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
15322024-09-05T00:42:07.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 1.434138057s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
15332024-09-05T00:42:07.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.341669982s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
15342024-09-05T00:42:07.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 554.633101ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
15352024-09-05T00:42:07.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 1.090063994s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
15362024-09-05T00:42:07.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 1.281616682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
15372024-09-05T00:42:07.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 1.494942078s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
15382024-09-05T00:42:07.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 537.678248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
15392024-09-05T00:42:07.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 1.129272856s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
15402024-09-05T00:42:08.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 862.970151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
15412024-09-05T00:42:08.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 754.544538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
15422024-09-05T00:42:08.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 1.294697641s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
15432024-09-05T00:42:08.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 1.438712956s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
15442024-09-05T00:42:08.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 703.119107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
15452024-09-05T00:42:08.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 1.371629701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
15462024-09-05T00:42:08.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 619.497647ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
15472024-09-05T00:42:08.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 1.228408184s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
15482024-09-05T00:42:08.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 693.837796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
15492024-09-05T00:42:08.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 875.501209ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
15502024-09-05T00:42:08.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.146176176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
15512024-09-05T00:42:08.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 713.921986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
15522024-09-05T00:42:08.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 547.068886ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
15532024-09-05T00:42:08.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 890.538001ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
15542024-09-05T00:42:08.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81") failed: Property not found. retry in 1.321729926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
15552024-09-05T00:42:08.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 838.757675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
15562024-09-05T00:42:08.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01") failed: Property not found. retry in 1.141778646s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
15572024-09-05T00:42:08.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 996.641287ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
15582024-09-05T00:42:09.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 523.652877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
15592024-09-05T00:42:09.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd") failed: Property not found. retry in 987.066255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
15602024-09-05T00:42:09.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d") failed: Property not found. retry in 1.119496892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
15612024-09-05T00:42:09.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e") failed: Property not found. retry in 952.471436ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
15622024-09-05T00:42:09.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f") failed: Property not found. retry in 1.394576766s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
15632024-09-05T00:42:09.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027") failed: Property not found. retry in 900.229858ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
15642024-09-05T00:42:09.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 597.878854ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
15652024-09-05T00:42:09.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46") failed: Property not found. retry in 1.350258978s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
15662024-09-05T00:42:09.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6") failed: Property not found. retry in 988.814109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
15672024-09-05T00:42:09.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48") failed: Property not found. retry in 601.966873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
15682024-09-05T00:42:09.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284") failed: Property not found. retry in 1.069566383s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
15692024-09-05T00:42:09.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2") failed: Property not found. retry in 849.923105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
15702024-09-05T00:42:09.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e") failed: Property not found. retry in 1.492318034s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
15712024-09-05T00:42:09.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d") failed: Property not found. retry in 930.440351ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
15722024-09-05T00:42:09.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe") failed: Property not found. retry in 636.598243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
15732024-09-05T00:42:09.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114") failed: Property not found. retry in 921.506374ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
15742024-09-05T00:42:09.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e") failed: Property not found. retry in 521.088407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
15752024-09-05T00:42:09.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b") failed: Property not found. retry in 719.066765ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
15762024-09-05T00:42:09.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 501.234939ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
15772024-09-05T00:42:10.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 1.162224636s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
15782024-09-05T00:42:10.790ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.100046959s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
15792024-09-05T00:42:11.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 638.060611ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
15802024-09-05T00:42:12.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 661.623327ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
15812024-09-05T00:42:13.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f") failed: Property not found. retry in 1.012894849s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
15822024-09-05T00:42:14.083ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_8d016a7d-8807-43bd-a371-c6c811de8d5f
15832024-09-05T00:42:14.083ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_37574d1d-8666-494d-9105-095f4f3a572d
15842024-09-05T00:42:14.083ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_90398b44-8c65-4385-b2a0-927f107fae01
15852024-09-05T00:42:14.083ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_2f17e7e7-64f2-4af1-a2c5-a8288deebebe
15862024-09-05T00:42:14.083ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_nexus_5f1fb376-349f-4b39-808a-5aa5abc60b1e
15872024-09-05T00:42:14.083ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_external_dns_145d6d08-bb1c-4557-af3d-b3b8e647b114
15882024-09-05T00:42:14.083ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_cc4cd44d-16d0-4417-aff1-8a9bb1e2f8f2
15892024-09-05T00:42:14.083ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_2d7bafea-257e-4f99-bb9d-4d921ef2a3b6
15902024-09-05T00:42:14.083ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_nexus_7171adea-be80-48c5-a65b-fe3a55b4870d
15912024-09-05T00:42:14.083ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_nexus_c8b7e56a-4fd1-4100-8ded-5a17ea178a46
15922024-09-05T00:42:14.084ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_external_dns_4aa18504-a7e8-4aa1-94fe-a65abab62a4b
15932024-09-05T00:42:14.084ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_oximeter_19d1dcd9-c605-423b-803d-56a986947027
15942024-09-05T00:42:14.084ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_pantry_86c1fd8e-cd6c-48be-a19b-71d584272d48
15952024-09-05T00:42:14.084ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_ba398f64-a1fa-4409-b695-7cb384241284
15962024-09-05T00:42:14.084ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_7dbcf7e9-e75b-4eca-a6ad-1ca15756fb4e
15972024-09-05T00:42:14.084ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_clickhouse_4e27a9e7-0a83-45ce-b6d1-0d5cfed1c92f
15982024-09-05T00:42:14.084ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_pantry_69311403-3792-46ef-887d-99994caeb32e
15992024-09-05T00:42:14.084ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_pantry_17177985-1bf4-4791-b114-8df9b15668dd
16002024-09-05T00:42:14.084ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3226 zone = oxz_crucible_b137109e-22bc-49b0-bb4b-a04bc6f3ef81
16012024-09-05T00:42:14.084ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16022024-09-05T00:42:14.087ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16032024-09-05T00:42:14.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41292416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39268 req_id = 2d268da0-9eed-421e-b990-ff6fe13a2a28 response_code = 204 uri = /omicron-zones
16042024-09-05T00:42:14.093ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1286
16052024-09-05T00:42:14.093ZINFOSledAgent (RSS): Writing ledger to /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16062024-09-05T00:42:14.093ZINFOSledAgent (RSS): Writing ledger to /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16072024-09-05T00:42:14.102ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:687
16082024-09-05T00:42:14.103ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:700
16092024-09-05T00:42:14.136ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), local_pref: None, nexthop: 10.151.1.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:867
16102024-09-05T00:42:14.138ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16112024-09-05T00:42:14.281ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16122024-09-05T00:42:14.412ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16132024-09-05T00:42:14.554ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16142024-09-05T00:42:14.654ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16152024-09-05T00:42:14.860ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16162024-09-05T00:42:15.083ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16172024-09-05T00:42:15.345ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16182024-09-05T00:42:15.722ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16192024-09-05T00:42:16.331ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16202024-09-05T00:42:16.950ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16212024-09-05T00:42:17.568ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16222024-09-05T00:42:18.012ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16232024-09-05T00:42:19.026ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16242024-09-05T00:42:19.925ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.590319482s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
16252024-09-05T00:42:20.266ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16262024-09-05T00:42:20.987ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16272024-09-05T00:42:22.960ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16282024-09-05T00:42:24.810ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16292024-09-05T00:42:27.350ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16302024-09-05T00:42:28.549ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 41.591996962s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
16312024-09-05T00:42:30.530ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/be337c62-4580-4975-a5e7-eb97e51b444b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
16322024-09-05T00:42:32.860ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49195
16332024-09-05T00:42:32.860ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49195 req_id = db80460c-11bc-4af2-8cec-f1a39595a804 response_code = 200 uri = /baseboard
16342024-09-05T00:42:33.691ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "07859926-546f-4fbb-8e27-55f26bd8a214", "content-length": "173", "date": "Thu, 05 Sep 2024 00:42:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"be337c62-4580-4975-a5e7-eb97e51b444b\"", request_id: "07859926-546f-4fbb-8e27-55f26bd8a214" } file = sled-agent/src/rack_setup/service.rs:929
16352024-09-05T00:42:36.905ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5d179cc1-b381-49f6-9418-43c00dd976e8", "content-length": "173", "date": "Thu, 05 Sep 2024 00:42:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a014d257-275c-449e-a4f4-aef00eab141c\"", request_id: "5d179cc1-b381-49f6-9418-43c00dd976e8" } file = sled-agent/src/rack_setup/service.rs:929
16362024-09-05T00:42:42.968ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:544 new_generation = 1 old_generation = 1 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
16372024-09-05T00:42:43.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59086
16382024-09-05T00:42:43.165ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16392024-09-05T00:42:43.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99433 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59086 req_id = f6e2ee51-4d6a-4fd4-a773-4c5c0f00f94a response_code = 200 uri = /inventory
16402024-09-05T00:42:43.263ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16412024-09-05T00:42:43.263ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/omicron-zones.json file = common/src/ledger.rs:177
16422024-09-05T00:42:43.264ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/omicron-zones.json file = common/src/ledger.rs:177
16432024-09-05T00:42:43.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 983 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59086 req_id = 9305d1c0-6ecc-4716-ab75-f7f9296677b4 response_code = 200 uri = /omicron-zones
16442024-09-05T00:42:44.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37151
16452024-09-05T00:42:44.199ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4201fb72-62c9-4bc9-b4fd-ee3284095ee8, kind: Service { id: 145d6d08-bb1c-4557-af3d-b3b8e647b114 }, name: Name("external-dns-145d6d08-bb1c-4557-af3d-b3b8e647b114"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 139])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60a23721-fd77-4d33-a0a4-0735bb775681, kind: Service { id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b }, name: Name("external-dns-4aa18504-a7e8-4aa1-94fe-a65abab62a4b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03971845-77e2-4239-964a-04e9c3f9d11e, kind: Service { id: c8b7e56a-4fd1-4100-8ded-5a17ea178a46 }, name: Name("nexus-c8b7e56a-4fd1-4100-8ded-5a17ea178a46"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9f0144bd-0194-4864-a015-629f3aebd42c, kind: Service { id: 7171adea-be80-48c5-a65b-fe3a55b4870d }, name: Name("nexus-7171adea-be80-48c5-a65b-fe3a55b4870d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc066fb6-a099-4780-b3f0-61b984118b4f, kind: Service { id: 5f1fb376-349f-4b39-808a-5aa5abc60b1e }, name: Name("nexus-5f1fb376-349f-4b39-808a-5aa5abc60b1e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 225])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16462024-09-05T00:42:44.199ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16472024-09-05T00:42:44.199ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16482024-09-05T00:42:44.199ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16492024-09-05T00:42:44.199ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
16502024-09-05T00:42:44.199ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16512024-09-05T00:42:44.199ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16522024-09-05T00:42:44.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 14294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37151 req_id = 01e17b62-10db-4e73-996f-2c4bcc4552f9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16532024-09-05T00:42:44.201ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:939
16542024-09-05T00:42:44.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62830
16552024-09-05T00:42:44.518ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16562024-09-05T00:42:44.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92923 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62830 req_id = a401958c-3c98-40b5-8502-5ec77d2e9d40 response_code = 200 uri = /inventory
16572024-09-05T00:42:44.611ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16582024-09-05T00:42:44.611ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/config/omicron-zones.json file = common/src/ledger.rs:177
16592024-09-05T00:42:44.611ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/config/omicron-zones.json file = common/src/ledger.rs:177
16602024-09-05T00:42:44.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 752 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62830 req_id = 1b65f95a-ae08-4efd-b273-1de09fcef8ab response_code = 200 uri = /omicron-zones
16612024-09-05T00:42:44.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44261
16622024-09-05T00:42:44.844ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4201fb72-62c9-4bc9-b4fd-ee3284095ee8, kind: Service { id: 145d6d08-bb1c-4557-af3d-b3b8e647b114 }, name: Name("external-dns-145d6d08-bb1c-4557-af3d-b3b8e647b114"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 139])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60a23721-fd77-4d33-a0a4-0735bb775681, kind: Service { id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b }, name: Name("external-dns-4aa18504-a7e8-4aa1-94fe-a65abab62a4b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03971845-77e2-4239-964a-04e9c3f9d11e, kind: Service { id: c8b7e56a-4fd1-4100-8ded-5a17ea178a46 }, name: Name("nexus-c8b7e56a-4fd1-4100-8ded-5a17ea178a46"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9f0144bd-0194-4864-a015-629f3aebd42c, kind: Service { id: 7171adea-be80-48c5-a65b-fe3a55b4870d }, name: Name("nexus-7171adea-be80-48c5-a65b-fe3a55b4870d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc066fb6-a099-4780-b3f0-61b984118b4f, kind: Service { id: 5f1fb376-349f-4b39-808a-5aa5abc60b1e }, name: Name("nexus-5f1fb376-349f-4b39-808a-5aa5abc60b1e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 225])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16632024-09-05T00:42:44.844ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16642024-09-05T00:42:44.845ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16652024-09-05T00:42:44.845ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16662024-09-05T00:42:44.845ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
16672024-09-05T00:42:44.845ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16682024-09-05T00:42:44.845ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16692024-09-05T00:42:44.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44261 req_id = ea20b3d6-a0a8-4149-91de-0eef7f66dfc5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16702024-09-05T00:42:45.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58411
16712024-09-05T00:42:45.761ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4201fb72-62c9-4bc9-b4fd-ee3284095ee8, kind: Service { id: 145d6d08-bb1c-4557-af3d-b3b8e647b114 }, name: Name("external-dns-145d6d08-bb1c-4557-af3d-b3b8e647b114"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 139])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60a23721-fd77-4d33-a0a4-0735bb775681, kind: Service { id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b }, name: Name("external-dns-4aa18504-a7e8-4aa1-94fe-a65abab62a4b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03971845-77e2-4239-964a-04e9c3f9d11e, kind: Service { id: c8b7e56a-4fd1-4100-8ded-5a17ea178a46 }, name: Name("nexus-c8b7e56a-4fd1-4100-8ded-5a17ea178a46"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9f0144bd-0194-4864-a015-629f3aebd42c, kind: Service { id: 7171adea-be80-48c5-a65b-fe3a55b4870d }, name: Name("nexus-7171adea-be80-48c5-a65b-fe3a55b4870d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc066fb6-a099-4780-b3f0-61b984118b4f, kind: Service { id: 5f1fb376-349f-4b39-808a-5aa5abc60b1e }, name: Name("nexus-5f1fb376-349f-4b39-808a-5aa5abc60b1e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 225])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16722024-09-05T00:42:45.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16732024-09-05T00:42:45.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16742024-09-05T00:42:45.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16752024-09-05T00:42:45.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
16762024-09-05T00:42:45.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16772024-09-05T00:42:45.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16782024-09-05T00:42:45.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58411 req_id = a35ce61d-710e-4a25-b153-d4e0fac2287e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16792024-09-05T00:42:45.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37227
16802024-09-05T00:42:45.813ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4201fb72-62c9-4bc9-b4fd-ee3284095ee8, kind: Service { id: 145d6d08-bb1c-4557-af3d-b3b8e647b114 }, name: Name("external-dns-145d6d08-bb1c-4557-af3d-b3b8e647b114"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 139])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60a23721-fd77-4d33-a0a4-0735bb775681, kind: Service { id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b }, name: Name("external-dns-4aa18504-a7e8-4aa1-94fe-a65abab62a4b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03971845-77e2-4239-964a-04e9c3f9d11e, kind: Service { id: c8b7e56a-4fd1-4100-8ded-5a17ea178a46 }, name: Name("nexus-c8b7e56a-4fd1-4100-8ded-5a17ea178a46"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9f0144bd-0194-4864-a015-629f3aebd42c, kind: Service { id: 7171adea-be80-48c5-a65b-fe3a55b4870d }, name: Name("nexus-7171adea-be80-48c5-a65b-fe3a55b4870d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc066fb6-a099-4780-b3f0-61b984118b4f, kind: Service { id: 5f1fb376-349f-4b39-808a-5aa5abc60b1e }, name: Name("nexus-5f1fb376-349f-4b39-808a-5aa5abc60b1e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 225])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16812024-09-05T00:42:45.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16822024-09-05T00:42:45.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16832024-09-05T00:42:45.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16842024-09-05T00:42:45.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
16852024-09-05T00:42:45.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16862024-09-05T00:42:45.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16872024-09-05T00:42:45.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37227 req_id = ac7b8426-92da-43dd-9710-13ef77c2d55d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16882024-09-05T00:42:54.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45794
16892024-09-05T00:42:54.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5460 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45794 req_id = 4f600a39-db7b-46c7-912f-2ccba295dc1b response_code = 200 uri = /vpc-routes
16902024-09-05T00:42:54.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 953 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45794 req_id = 29c5ede9-1586-4b72-aa06-475034384c7d response_code = 204 uri = /vpc-routes
16912024-09-05T00:43:02.895ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58668
16922024-09-05T00:43:02.895ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58668 req_id = 8440e9fd-4be6-4876-8bad-77e9c9696f85 response_code = 200 uri = /baseboard
16932024-09-05T00:43:04.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36018
16942024-09-05T00:43:04.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 934 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36018 req_id = f80edc13-2c80-4192-8b75-f19687061e25 response_code = 200 uri = /vpc-routes
16952024-09-05T00:43:04.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36018 req_id = bf2f2a45-cbd1-41b8-b6c2-d16c51b80828 response_code = 204 uri = /vpc-routes
16962024-09-05T00:43:04.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59992
16972024-09-05T00:43:04.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59992 req_id = fccf6a57-8e56-4918-8f72-ec9d7a7172d7 response_code = 200 uri = /vpc-routes
16982024-09-05T00:43:04.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59992 req_id = ccbc4adf-4ef3-4edb-8703-dda202ead16d response_code = 204 uri = /vpc-routes
16992024-09-05T00:43:04.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61223
17002024-09-05T00:43:04.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61223 req_id = 3baa546b-0499-4625-a692-d55ab15a8473 response_code = 200 uri = /v2p
17012024-09-05T00:43:04.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54368
17022024-09-05T00:43:04.946ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
17032024-09-05T00:43:05.014ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
17042024-09-05T00:43:05.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 135450 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54368 req_id = b3edfdc0-21a8-41b9-b626-6aef9d436fba response_code = 204 uri = /switch-ports
17052024-09-05T00:43:05.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46814
17062024-09-05T00:43:05.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55767
17072024-09-05T00:43:05.081ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
17082024-09-05T00:43:05.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46814 req_id = 37f1ff8f-e9ac-4999-8cc7-0d693388e48a response_code = 200 uri = /v2p
17092024-09-05T00:43:05.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5367 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54368 req_id = 41ed55d9-9d8b-44c6-a78a-7a8c2e15a2fa response_code = 200 uri = /network-bootstore-config
17102024-09-05T00:43:05.121ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
17112024-09-05T00:43:05.143ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17122024-09-05T00:43:05.143ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17132024-09-05T00:43:05.145ZINFOSledAgent (bootstore): Writing ledger to /pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17142024-09-05T00:43:05.146ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17152024-09-05T00:43:05.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5476 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54368 req_id = 7296545d-49b4-49c5-9408-a38e6fa95bba response_code = 204 uri = /network-bootstore-config
17162024-09-05T00:43:05.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58140
17172024-09-05T00:43:05.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58140 req_id = 211e98a4-3b39-42a9-b4a5-9f60b8cc928f response_code = 200 uri = /vpc-routes
17182024-09-05T00:43:05.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55767 req_id = cc9a9c99-fa8d-4a04-aa52-1faf2d3ed34f response_code = 204 uri = /switch-ports
17192024-09-05T00:43:05.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55767 req_id = 8e59fb77-3ac4-42a9-9f5e-41ea9005de43 response_code = 200 uri = /network-bootstore-config
17202024-09-05T00:43:05.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33894
17212024-09-05T00:43:05.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33894 req_id = fef9ffc4-43fa-47dd-be3d-d5231033626e response_code = 200 uri = /v2p
17222024-09-05T00:43:05.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58140 req_id = c1187873-169c-491c-8ba3-473059d70229 response_code = 204 uri = /vpc-routes
17232024-09-05T00:43:05.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60655
17242024-09-05T00:43:05.244ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
17252024-09-05T00:43:05.277ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
17262024-09-05T00:43:05.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 83961 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60655 req_id = 3b417877-9417-43cd-a3b3-0d4ead5a15bd response_code = 204 uri = /switch-ports
17272024-09-05T00:43:05.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60655 req_id = 99f89977-a8de-4ecb-83bd-42a7aa769e99 response_code = 200 uri = /network-bootstore-config
17282024-09-05T00:43:32.928ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52764
17292024-09-05T00:43:32.928ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52764 req_id = c984c2c8-8000-4141-807a-3699f7478b1b response_code = 200 uri = /baseboard
17302024-09-05T00:43:34.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45262
17312024-09-05T00:43:34.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45262 req_id = f6108ae8-19a8-48ce-a2ea-942a1000ddf5 response_code = 200 uri = /vpc-routes
17322024-09-05T00:43:34.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45262 req_id = dc4506e6-5cf7-4c71-878c-b6122c5f9fc2 response_code = 204 uri = /vpc-routes
17332024-09-05T00:43:34.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51487
17342024-09-05T00:43:34.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51487 req_id = 2d6007b3-cf73-4a2a-a747-9e0b53d0376d response_code = 200 uri = /vpc-routes
17352024-09-05T00:43:34.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51487 req_id = 5148965b-c616-453b-85bb-320dcbd71b20 response_code = 204 uri = /vpc-routes
17362024-09-05T00:43:34.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35465
17372024-09-05T00:43:34.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35465 req_id = 76e6033e-e9c4-4e66-b553-a0a2722d157d response_code = 200 uri = /v2p
17382024-09-05T00:43:35.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50582
17392024-09-05T00:43:35.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50582 req_id = ce79d7c7-5820-4860-aed6-5fba3f3269b0 response_code = 200 uri = /v2p
17402024-09-05T00:43:35.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33753
17412024-09-05T00:43:35.132ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
17422024-09-05T00:43:35.168ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
17432024-09-05T00:43:35.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90813 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33753 req_id = b286ce96-e4f5-4ed3-82f2-4a3047a37bd3 response_code = 204 uri = /switch-ports
17442024-09-05T00:43:35.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33753 req_id = 7d350f49-fe66-4bea-918e-788f12bba1e3 response_code = 200 uri = /network-bootstore-config
17452024-09-05T00:43:35.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47680
17462024-09-05T00:43:35.245ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
17472024-09-05T00:43:35.288ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
17482024-09-05T00:43:35.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 105883 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47680 req_id = 08c839d2-d1ba-4004-b5da-c6a94f6e65c5 response_code = 204 uri = /switch-ports
17492024-09-05T00:43:35.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60957
17502024-09-05T00:43:35.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60957 req_id = 5b97be5e-1886-4594-a9b9-eb967037ea7b response_code = 200 uri = /vpc-routes
17512024-09-05T00:43:35.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47680 req_id = 5a595995-f901-4999-b85d-a61efab01762 response_code = 200 uri = /network-bootstore-config
17522024-09-05T00:43:35.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60957 req_id = 606fe49d-b552-4cd5-8f83-f831ac22fd32 response_code = 204 uri = /vpc-routes
17532024-09-05T00:43:35.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52865
17542024-09-05T00:43:35.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52865 req_id = 02da6d5c-0dd5-4edf-9f35-6ff746db499d response_code = 200 uri = /v2p
17552024-09-05T00:43:35.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33717
17562024-09-05T00:43:35.522ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
17572024-09-05T00:43:35.562ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
17582024-09-05T00:43:35.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33717 req_id = 81b99d00-a194-4590-9fcd-a24f0eba147c response_code = 204 uri = /switch-ports
17592024-09-05T00:43:35.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33717 req_id = 30d33cfd-3f29-41c8-a3b2-1517fe028ea9 response_code = 200 uri = /network-bootstore-config
17602024-09-05T00:43:40.254ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:33551 remote_addr = [fd00:1122:3344:101::d]:62182 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
17612024-09-05T00:43:40.292ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 37125 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = 9d512959-ae81-4b67-b59d-10a57aaba2ef response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
17622024-09-05T00:44:02.961ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36923
17632024-09-05T00:44:02.961ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36923 req_id = d02fe6b7-73d1-4b59-aa6c-d21e834a49fe response_code = 200 uri = /baseboard
17642024-09-05T00:44:04.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42133
17652024-09-05T00:44:04.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42133 req_id = cc6ba3ac-ac09-4c31-8bfc-e1a90f0b2905 response_code = 200 uri = /vpc-routes
17662024-09-05T00:44:04.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49440
17672024-09-05T00:44:04.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49440 req_id = 3e223f6f-8d73-4015-bd36-114b4783257c response_code = 200 uri = /vpc-routes
17682024-09-05T00:44:04.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42133 req_id = 107be09c-bfc3-4a90-9156-aa3f6be9c5bb response_code = 204 uri = /vpc-routes
17692024-09-05T00:44:04.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49440 req_id = e6b54739-82c8-410b-8b9f-b51785c0889f response_code = 204 uri = /vpc-routes
17702024-09-05T00:44:04.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59505
17712024-09-05T00:44:04.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 991 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59505 req_id = 9b738066-20eb-458b-9431-0fa41a9ae5db response_code = 200 uri = /v2p
17722024-09-05T00:44:04.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58782
17732024-09-05T00:44:04.880ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
17742024-09-05T00:44:04.916ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
17752024-09-05T00:44:04.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99767 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58782 req_id = c6f4bba1-ed71-4428-b929-ba795b4a34b1 response_code = 204 uri = /switch-ports
17762024-09-05T00:44:04.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62984
17772024-09-05T00:44:04.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60081
17782024-09-05T00:44:04.982ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
17792024-09-05T00:44:04.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2367 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60081 req_id = 50910965-35c7-4cba-aca2-33c60c402023 response_code = 200 uri = /v2p
17802024-09-05T00:44:04.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58782 req_id = 4e0d8bb7-4bf0-4cfb-98d0-075769393238 response_code = 200 uri = /network-bootstore-config
17812024-09-05T00:44:05.032ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
17822024-09-05T00:44:05.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 114671 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62984 req_id = 88286a95-6ebe-4743-8ab3-342327447d6f response_code = 204 uri = /switch-ports
17832024-09-05T00:44:05.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62984 req_id = fe79eaea-07ce-40a3-849f-253e2d40995c response_code = 200 uri = /network-bootstore-config
17842024-09-05T00:44:05.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40335
17852024-09-05T00:44:05.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40335 req_id = 6ac65904-230d-425d-b649-6a2e9f5b5b9e response_code = 200 uri = /vpc-routes
17862024-09-05T00:44:05.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40335 req_id = c0a2ef15-72f4-4395-9009-f9a7f10dd83f response_code = 204 uri = /vpc-routes
17872024-09-05T00:44:05.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60322
17882024-09-05T00:44:05.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60322 req_id = afd225a4-2721-47d8-b752-ad468d73b64c response_code = 200 uri = /v2p
17892024-09-05T00:44:05.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52173
17902024-09-05T00:44:05.334ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
17912024-09-05T00:44:05.373ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
17922024-09-05T00:44:05.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93168 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52173 req_id = 9dd9def5-fb45-4815-850c-978ba173381c response_code = 204 uri = /switch-ports
17932024-09-05T00:44:05.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52173 req_id = 728d0b87-310b-4b99-8b62-4bd3dc3b428a response_code = 200 uri = /network-bootstore-config
17942024-09-05T00:44:10.261ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6808 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = 78b4d2ff-05bc-44ed-be12-c7655a6c6ca0 response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
17952024-09-05T00:44:32.996ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41946
17962024-09-05T00:44:32.997ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 965 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41946 req_id = d5d30c22-fb9d-4362-b42c-a793f34fd2be response_code = 200 uri = /baseboard
17972024-09-05T00:44:34.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40059
17982024-09-05T00:44:34.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40059 req_id = 6b90a6c2-807d-47e5-983f-e01fde27f2b4 response_code = 200 uri = /vpc-routes
17992024-09-05T00:44:34.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40059 req_id = ceb40b9e-f0f4-47a7-8848-ceeb970b9991 response_code = 204 uri = /vpc-routes
18002024-09-05T00:44:34.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52221
18012024-09-05T00:44:34.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52221 req_id = a176f29e-9f10-44f8-9ea6-e95f2c3e168c response_code = 200 uri = /vpc-routes
18022024-09-05T00:44:34.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39915
18032024-09-05T00:44:34.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39915 req_id = b8c2744e-8317-4af8-ba31-a8bb882273c8 response_code = 200 uri = /v2p
18042024-09-05T00:44:34.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1629 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52221 req_id = 9b147aa0-3022-4994-8a6e-c7aebb0d3b6f response_code = 204 uri = /vpc-routes
18052024-09-05T00:44:35.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53630
18062024-09-05T00:44:35.110ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
18072024-09-05T00:44:35.151ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
18082024-09-05T00:44:35.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103144 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53630 req_id = b7e145b7-8bab-48fa-9b5e-f97c545bef72 response_code = 204 uri = /switch-ports
18092024-09-05T00:44:35.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58837
18102024-09-05T00:44:35.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1013 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53630 req_id = 3aaea87d-ab0e-45e9-9f00-96609d41a40d response_code = 200 uri = /network-bootstore-config
18112024-09-05T00:44:35.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 979 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58837 req_id = 426e2275-5fb2-4823-ab9a-89797572ed9b response_code = 200 uri = /v2p
18122024-09-05T00:44:35.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34260
18132024-09-05T00:44:35.253ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
18142024-09-05T00:44:35.289ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
18152024-09-05T00:44:35.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92095 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34260 req_id = b7d0efed-6e6e-4105-a2a9-ff6373454f7a response_code = 204 uri = /switch-ports
18162024-09-05T00:44:35.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48893
18172024-09-05T00:44:35.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42435
18182024-09-05T00:44:35.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 749 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42435 req_id = cfc876f9-31a1-4e34-b1f4-a8bbbf3fd519 response_code = 200 uri = /vpc-routes
18192024-09-05T00:44:35.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 828 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34260 req_id = eb688e4f-7a11-4889-afd1-28c3ed14d35e response_code = 200 uri = /network-bootstore-config
18202024-09-05T00:44:35.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 877 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48893 req_id = c6ae2223-fa5b-45d1-a6b6-901ca1fa3fe4 response_code = 200 uri = /v2p
18212024-09-05T00:44:35.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42435 req_id = 428a154a-7f3f-4997-87b3-d6f7d0de5dd3 response_code = 204 uri = /vpc-routes
18222024-09-05T00:44:35.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41359
18232024-09-05T00:44:35.461ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
18242024-09-05T00:44:35.498ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
18252024-09-05T00:44:35.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41359 req_id = a5618443-7a81-4af0-a31a-5cbc4ec5b6ce response_code = 204 uri = /switch-ports
18262024-09-05T00:44:35.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41359 req_id = b2454c0f-72f2-4f34-a5c6-3debca044b43 response_code = 200 uri = /network-bootstore-config
18272024-09-05T00:44:40.261ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6818 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = 62318953-0980-4b3f-909d-4408eeb39475 response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
18282024-09-05T00:45:03.035ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64829
18292024-09-05T00:45:03.035ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64829 req_id = b6aa5c7f-b557-4f65-9e59-b1fd85c1d6eb response_code = 200 uri = /baseboard
18302024-09-05T00:45:04.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40199
18312024-09-05T00:45:04.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40199 req_id = f45ebe9f-a2c3-4648-b7ee-11df3ed5be27 response_code = 200 uri = /vpc-routes
18322024-09-05T00:45:04.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40199 req_id = 9fd043d3-09b3-4a59-8a6f-3019dafa4c28 response_code = 204 uri = /vpc-routes
18332024-09-05T00:45:04.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52130
18342024-09-05T00:45:04.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52130 req_id = 70ce8c03-e132-4b07-bf75-1d0ea786531f response_code = 200 uri = /vpc-routes
18352024-09-05T00:45:04.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 900 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52130 req_id = b7c20856-0b8d-42e6-adfe-0a7a9995cc04 response_code = 204 uri = /vpc-routes
18362024-09-05T00:45:04.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39476
18372024-09-05T00:45:04.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39476 req_id = a6a1b305-19dc-4ebc-ba5e-6d8eef9f6e4d response_code = 200 uri = /v2p
18382024-09-05T00:45:04.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34874
18392024-09-05T00:45:04.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 862 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34874 req_id = ea5b2891-e492-4c95-b3fd-dbf93d442b53 response_code = 200 uri = /v2p
18402024-09-05T00:45:04.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58794
18412024-09-05T00:45:04.972ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
18422024-09-05T00:45:05.025ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
18432024-09-05T00:45:05.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 121828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58794 req_id = 462c23e8-8e16-443e-9396-722b96e14026 response_code = 204 uri = /switch-ports
18442024-09-05T00:45:05.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47593
18452024-09-05T00:45:05.094ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
18462024-09-05T00:45:05.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3749 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58794 req_id = 2e678786-d97b-4347-a5e5-eee95e6ad4ec response_code = 200 uri = /network-bootstore-config
18472024-09-05T00:45:05.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64573
18482024-09-05T00:45:05.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64573 req_id = f9d9366e-5a3e-432d-af36-ea78d18a02c8 response_code = 200 uri = /vpc-routes
18492024-09-05T00:45:05.130ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
18502024-09-05T00:45:05.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64573 req_id = 413bb854-a9b2-4d29-8c3b-73c781ddd5d5 response_code = 204 uri = /vpc-routes
18512024-09-05T00:45:05.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99384 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47593 req_id = 633a88c6-d5df-4f14-ab8d-b6c677dfa2c0 response_code = 204 uri = /switch-ports
18522024-09-05T00:45:05.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47593 req_id = a7029a15-d038-420c-a7c9-d396f9444069 response_code = 200 uri = /network-bootstore-config
18532024-09-05T00:45:05.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50486
18542024-09-05T00:45:05.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 970 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50486 req_id = 69228052-ea51-490a-bd80-9a7d91e2310f response_code = 200 uri = /v2p
18552024-09-05T00:45:05.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61676
18562024-09-05T00:45:05.346ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
18572024-09-05T00:45:05.385ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
18582024-09-05T00:45:05.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94545 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61676 req_id = 902edacd-9851-4738-a394-5136fcff5dee response_code = 204 uri = /switch-ports
18592024-09-05T00:45:05.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61676 req_id = 71c02870-b104-4749-92a7-78fe4ca4bc5a response_code = 200 uri = /network-bootstore-config
18602024-09-05T00:45:10.261ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5582 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = c4813a2f-9eb6-4d36-bb0a-1c720422c870 response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
18612024-09-05T00:45:16.786ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18622024-09-05T00:45:33.067ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52747
18632024-09-05T00:45:33.067ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52747 req_id = b940f946-0687-4efd-afc7-08f8e9208ac3 response_code = 200 uri = /baseboard
18642024-09-05T00:45:34.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59075
18652024-09-05T00:45:34.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59075 req_id = 4f4dd014-519d-4188-9b93-74182a28b8e6 response_code = 200 uri = /vpc-routes
18662024-09-05T00:45:35.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59075 req_id = d734df3b-5236-4371-af56-add26c818b4d response_code = 204 uri = /vpc-routes
18672024-09-05T00:45:35.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39368
18682024-09-05T00:45:35.109ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
18692024-09-05T00:45:35.154ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
18702024-09-05T00:45:35.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39368 req_id = 57060145-75fd-42ff-9842-65824f52a3cc response_code = 204 uri = /switch-ports
18712024-09-05T00:45:35.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46167
18722024-09-05T00:45:35.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51042
18732024-09-05T00:45:35.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63967
18742024-09-05T00:45:35.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63967 req_id = e267230c-712a-4877-a928-afadee8eee24 response_code = 200 uri = /vpc-routes
18752024-09-05T00:45:35.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39368 req_id = e464398f-cdc2-4ad8-a3fa-0054f73100ff response_code = 200 uri = /network-bootstore-config
18762024-09-05T00:45:35.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46167 req_id = 03a99cf6-6425-4dc9-a9df-2fd5c4ba64ae response_code = 200 uri = /v2p
18772024-09-05T00:45:35.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51042 req_id = 729f3b69-0ea7-4e6e-9462-d3e538886719 response_code = 200 uri = /v2p
18782024-09-05T00:45:35.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63967 req_id = 6d9e21bc-a53e-488c-8f20-c5cc9090e4e4 response_code = 204 uri = /vpc-routes
18792024-09-05T00:45:35.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40194
18802024-09-05T00:45:35.258ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
18812024-09-05T00:45:35.294ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
18822024-09-05T00:45:35.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40194 req_id = da0471a0-da31-4c15-91b9-3cf35ccf5ddf response_code = 204 uri = /switch-ports
18832024-09-05T00:45:35.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40194 req_id = c8b8ecac-770c-4926-9be1-bab3accc031b response_code = 200 uri = /network-bootstore-config
18842024-09-05T00:45:35.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46141
18852024-09-05T00:45:35.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46141 req_id = c00faac4-f4d7-4e0a-a1da-4f1ad062a032 response_code = 200 uri = /vpc-routes
18862024-09-05T00:45:35.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46141 req_id = e326f555-7928-4b52-8695-b50882d9b291 response_code = 204 uri = /vpc-routes
18872024-09-05T00:45:35.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65153
18882024-09-05T00:45:35.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65153 req_id = 11a85edd-e32d-4932-bdff-3656b522d63d response_code = 200 uri = /v2p
18892024-09-05T00:45:35.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45872
18902024-09-05T00:45:35.465ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
18912024-09-05T00:45:35.502ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
18922024-09-05T00:45:35.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94137 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45872 req_id = 44444236-6330-4d9f-b8ae-96fe924dbb7a response_code = 204 uri = /switch-ports
18932024-09-05T00:45:35.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45872 req_id = 98fb4806-244b-43aa-81b0-bdc25f611094 response_code = 200 uri = /network-bootstore-config
18942024-09-05T00:45:40.278ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5575 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = 12a28414-df77-4660-a355-55635c9d0f87 response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
18952024-09-05T00:46:03.100ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65077
18962024-09-05T00:46:03.100ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65077 req_id = 959dca5e-018d-443a-8ff3-ce90c1eb73ea response_code = 200 uri = /baseboard
18972024-09-05T00:46:04.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62683
18982024-09-05T00:46:04.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1061 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62683 req_id = b3fc00eb-ea56-4769-8748-528ab6f2695e response_code = 200 uri = /vpc-routes
18992024-09-05T00:46:04.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62683 req_id = d55c2bb3-0f60-413b-8159-adf332448b25 response_code = 204 uri = /vpc-routes
19002024-09-05T00:46:04.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51784
19012024-09-05T00:46:04.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51784 req_id = fd7db0e8-c0d6-4b42-b44f-4c427e1b0b38 response_code = 200 uri = /v2p
19022024-09-05T00:46:04.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64981
19032024-09-05T00:46:04.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64981 req_id = 971e3b1d-6d7a-4ef8-81f5-fa22f68a6c05 response_code = 200 uri = /v2p
19042024-09-05T00:46:04.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62582
19052024-09-05T00:46:04.885ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
19062024-09-05T00:46:04.925ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
19072024-09-05T00:46:04.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113425 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62582 req_id = b0becf33-1f6c-4dfe-8379-c5bacf14949e response_code = 204 uri = /switch-ports
19082024-09-05T00:46:04.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65425
19092024-09-05T00:46:04.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65425 req_id = 87e0b716-55d9-4c0d-9e93-1e9adaac6500 response_code = 200 uri = /vpc-routes
19102024-09-05T00:46:04.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62582 req_id = c9831411-4d55-4df6-872e-28e6a3639cf0 response_code = 200 uri = /network-bootstore-config
19112024-09-05T00:46:05.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47759
19122024-09-05T00:46:05.001ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
19132024-09-05T00:46:05.048ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
19142024-09-05T00:46:05.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47759 req_id = b9f86c7d-eedd-46b8-95cd-edced52e2452 response_code = 204 uri = /switch-ports
19152024-09-05T00:46:05.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47759 req_id = 510911a6-ef00-42c2-ad2e-58ad77e61442 response_code = 200 uri = /network-bootstore-config
19162024-09-05T00:46:05.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65425 req_id = 5aeaa8b4-d9dc-427d-ba5b-6cf526b7cb70 response_code = 204 uri = /vpc-routes
19172024-09-05T00:46:05.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62846
19182024-09-05T00:46:05.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62846 req_id = d4bde395-bc70-4897-9a39-27f47600ac84 response_code = 200 uri = /vpc-routes
19192024-09-05T00:46:05.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62846 req_id = a40d075c-0111-455f-8a70-62b3f13930e6 response_code = 204 uri = /vpc-routes
19202024-09-05T00:46:05.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38160
19212024-09-05T00:46:05.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38160 req_id = e37576ef-8c4f-4e75-82b9-2178c6c883cc response_code = 200 uri = /v2p
19222024-09-05T00:46:05.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37690
19232024-09-05T00:46:05.403ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
19242024-09-05T00:46:05.442ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
19252024-09-05T00:46:05.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95678 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37690 req_id = 3a83d84c-da24-40fa-8914-2708b817bc19 response_code = 204 uri = /switch-ports
19262024-09-05T00:46:05.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37690 req_id = 70df60e0-cda7-4565-8914-ec11a4784118 response_code = 200 uri = /network-bootstore-config
19272024-09-05T00:46:10.344ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6981 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = 8afb1b18-ac57-412e-b373-ca6cbd2f235e response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
19282024-09-05T00:46:33.134ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47145
19292024-09-05T00:46:33.135ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47145 req_id = 81fe155d-bd80-42d3-99c5-b1dc639653a4 response_code = 200 uri = /baseboard
19302024-09-05T00:46:34.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49527
19312024-09-05T00:46:34.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 895 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49527 req_id = 37ef2c1e-62f7-4502-bfc9-8ad0a04e262a response_code = 200 uri = /vpc-routes
19322024-09-05T00:46:34.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49527 req_id = bf65d2a6-e357-474c-a9d2-0340c060d9e7 response_code = 204 uri = /vpc-routes
19332024-09-05T00:46:34.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50142
19342024-09-05T00:46:34.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 804 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50142 req_id = ca1791b7-7082-4d70-a003-375fee269a6c response_code = 200 uri = /vpc-routes
19352024-09-05T00:46:34.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50142 req_id = 0796abda-7a6f-412b-8d1a-5ac555933079 response_code = 204 uri = /vpc-routes
19362024-09-05T00:46:35.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63444
19372024-09-05T00:46:35.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63444 req_id = bca68d72-aca8-4604-96a6-4cdf7b9a2b6d response_code = 200 uri = /v2p
19382024-09-05T00:46:35.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45613
19392024-09-05T00:46:35.248ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
19402024-09-05T00:46:35.285ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
19412024-09-05T00:46:35.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95527 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45613 req_id = 181dbaec-0c6d-47c8-a46c-55f42b2f71c1 response_code = 204 uri = /switch-ports
19422024-09-05T00:46:35.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45115
19432024-09-05T00:46:35.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47831
19442024-09-05T00:46:35.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45613 req_id = 770ab0b9-5f55-4f32-8b56-fc6eee7bba15 response_code = 200 uri = /network-bootstore-config
19452024-09-05T00:46:35.344ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
19462024-09-05T00:46:35.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4729 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47831 req_id = b07a8015-80d7-46c2-a085-95d73d0ae67b response_code = 200 uri = /v2p
19472024-09-05T00:46:35.384ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
19482024-09-05T00:46:35.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96487 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45115 req_id = 8ce7928d-ed09-4b65-9a32-182fe5b47090 response_code = 204 uri = /switch-ports
19492024-09-05T00:46:35.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45115 req_id = cee14399-ed2b-4f3f-a699-d0e3b1eedf45 response_code = 200 uri = /network-bootstore-config
19502024-09-05T00:46:35.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49682
19512024-09-05T00:46:35.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49682 req_id = 5495c0f6-df5d-423f-843f-ebcdd5d735c2 response_code = 200 uri = /vpc-routes
19522024-09-05T00:46:35.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49682 req_id = a384d8be-2bf7-4665-9156-e2dcf0e98f6e response_code = 204 uri = /vpc-routes
19532024-09-05T00:46:35.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55351
19542024-09-05T00:46:35.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 558 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55351 req_id = 409a04d7-586e-44b6-9de2-e5f5d6d453a8 response_code = 200 uri = /v2p
19552024-09-05T00:46:35.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34340
19562024-09-05T00:46:35.543ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
19572024-09-05T00:46:35.579ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
19582024-09-05T00:46:35.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91546 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34340 req_id = 04d22f6e-9daa-4023-95e9-cf23ddfd90f0 response_code = 204 uri = /switch-ports
19592024-09-05T00:46:35.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34340 req_id = 3f8990fa-d0b8-4f95-9db1-86aa8eec7afc response_code = 200 uri = /network-bootstore-config
19602024-09-05T00:46:40.345ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7321 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = 6d851adc-1001-4ac1-bc37-5e41e67b24a6 response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
19612024-09-05T00:47:03.170ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59105
19622024-09-05T00:47:03.170ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59105 req_id = 26c4d369-88a5-40a9-9fba-27a3348d7338 response_code = 200 uri = /baseboard
19632024-09-05T00:47:04.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59224
19642024-09-05T00:47:04.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59224 req_id = 84ca3698-9c21-4548-99a4-2ee093e8e40b response_code = 200 uri = /vpc-routes
19652024-09-05T00:47:04.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59224 req_id = 2b6c023a-8675-4ccc-8945-828b395a5e0c response_code = 204 uri = /vpc-routes
19662024-09-05T00:47:04.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37515
19672024-09-05T00:47:04.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37515 req_id = adf6a142-ffa8-4a22-9ead-f1f336022861 response_code = 200 uri = /vpc-routes
19682024-09-05T00:47:04.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37515 req_id = 08389182-7ed5-46a5-a511-1ca67580a424 response_code = 204 uri = /vpc-routes
19692024-09-05T00:47:04.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35842
19702024-09-05T00:47:04.871ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
19712024-09-05T00:47:04.908ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
19722024-09-05T00:47:04.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93012 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35842 req_id = ad781c27-9222-43b3-854c-cca716cfe4ae response_code = 204 uri = /switch-ports
19732024-09-05T00:47:04.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42945
19742024-09-05T00:47:04.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44422
19752024-09-05T00:47:04.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35842 req_id = 120c71fd-af3e-452d-9c17-fee7c5972e3d response_code = 200 uri = /network-bootstore-config
19762024-09-05T00:47:04.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1543 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42945 req_id = eb35d923-e38a-4171-8bab-9139bfbd6299 response_code = 200 uri = /v2p
19772024-09-05T00:47:04.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1458 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44422 req_id = c5d3d64e-8b43-45d6-938d-a6f263c34711 response_code = 200 uri = /v2p
19782024-09-05T00:47:04.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63879
19792024-09-05T00:47:04.976ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
19802024-09-05T00:47:05.022ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
19812024-09-05T00:47:05.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109874 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63879 req_id = d05141b7-4ffe-4aed-933f-a16a888164fa response_code = 204 uri = /switch-ports
19822024-09-05T00:47:05.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38291
19832024-09-05T00:47:05.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63879 req_id = 509402dc-4ffe-4d52-9808-434f4fa5978b response_code = 200 uri = /network-bootstore-config
19842024-09-05T00:47:05.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 788 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38291 req_id = e731eca0-6776-4008-8fc6-7ced3d378e50 response_code = 200 uri = /vpc-routes
19852024-09-05T00:47:05.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38291 req_id = 4c5aeb5f-df53-42cb-977e-979b0aec1098 response_code = 204 uri = /vpc-routes
19862024-09-05T00:47:05.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52043
19872024-09-05T00:47:05.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52043 req_id = 7df12480-780f-4dbf-a9b8-95f521df5f67 response_code = 200 uri = /v2p
19882024-09-05T00:47:05.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40383
19892024-09-05T00:47:05.230ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
19902024-09-05T00:47:05.266ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
19912024-09-05T00:47:05.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90047 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40383 req_id = bbe6ffe0-eafe-404b-a1e7-a9e91853992a response_code = 204 uri = /switch-ports
19922024-09-05T00:47:05.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40383 req_id = fc3ff8d8-710c-4b5c-8ac2-6a3ba90037d3 response_code = 200 uri = /network-bootstore-config
19932024-09-05T00:47:10.345ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6421 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = 78a32a49-a902-42d5-860c-f51d617bfca6 response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
19942024-09-05T00:47:33.204ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52680
19952024-09-05T00:47:33.204ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52680 req_id = 13ce24e6-8ed7-4f31-b19f-83f694bad1d5 response_code = 200 uri = /baseboard
19962024-09-05T00:47:34.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51123
19972024-09-05T00:47:34.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51123 req_id = 98d35113-8c73-4579-b16e-b2a5c44eab07 response_code = 200 uri = /vpc-routes
19982024-09-05T00:47:34.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43117
19992024-09-05T00:47:34.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43117 req_id = 8a10491a-777b-4e7b-a35f-ad148e285ae3 response_code = 200 uri = /v2p
20002024-09-05T00:47:34.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51123 req_id = 2f352b18-a69a-4bf1-9c69-33381df7676c response_code = 204 uri = /vpc-routes
20012024-09-05T00:47:34.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50441
20022024-09-05T00:47:34.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50441 req_id = d32a1ba0-351e-45a0-baba-7cba9d146add response_code = 200 uri = /vpc-routes
20032024-09-05T00:47:35.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50441 req_id = 46c69661-5496-47bf-8d56-432a06f6ea48 response_code = 204 uri = /vpc-routes
20042024-09-05T00:47:35.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32952
20052024-09-05T00:47:35.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32952 req_id = 9cc76301-9d9b-4e81-865f-af6cf3f7066c response_code = 200 uri = /v2p
20062024-09-05T00:47:35.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41957
20072024-09-05T00:47:35.164ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
20082024-09-05T00:47:35.219ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
20092024-09-05T00:47:35.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 132800 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41957 req_id = cbcfc510-d7dd-43ee-aed9-77fd1f696dec response_code = 204 uri = /switch-ports
20102024-09-05T00:47:35.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42639
20112024-09-05T00:47:35.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56087
20122024-09-05T00:47:35.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42639 req_id = 8d63b5b0-da27-4f19-8afd-9385851ab77c response_code = 200 uri = /vpc-routes
20132024-09-05T00:47:35.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6719 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41957 req_id = e7516109-df1c-4461-8ed0-1d4d4eee8775 response_code = 200 uri = /network-bootstore-config
20142024-09-05T00:47:35.304ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
20152024-09-05T00:47:35.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60950
20162024-09-05T00:47:35.312ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4201fb72-62c9-4bc9-b4fd-ee3284095ee8, kind: Service { id: 145d6d08-bb1c-4557-af3d-b3b8e647b114 }, name: Name("external-dns-145d6d08-bb1c-4557-af3d-b3b8e647b114"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 139])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60a23721-fd77-4d33-a0a4-0735bb775681, kind: Service { id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b }, name: Name("external-dns-4aa18504-a7e8-4aa1-94fe-a65abab62a4b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03971845-77e2-4239-964a-04e9c3f9d11e, kind: Service { id: c8b7e56a-4fd1-4100-8ded-5a17ea178a46 }, name: Name("nexus-c8b7e56a-4fd1-4100-8ded-5a17ea178a46"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9f0144bd-0194-4864-a015-629f3aebd42c, kind: Service { id: 7171adea-be80-48c5-a65b-fe3a55b4870d }, name: Name("nexus-7171adea-be80-48c5-a65b-fe3a55b4870d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc066fb6-a099-4780-b3f0-61b984118b4f, kind: Service { id: 5f1fb376-349f-4b39-808a-5aa5abc60b1e }, name: Name("nexus-5f1fb376-349f-4b39-808a-5aa5abc60b1e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 225])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20172024-09-05T00:47:35.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20182024-09-05T00:47:35.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20192024-09-05T00:47:35.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20202024-09-05T00:47:35.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
20212024-09-05T00:47:35.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20222024-09-05T00:47:35.312ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20232024-09-05T00:47:35.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 832 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60950 req_id = c274f772-5008-4f7b-8de3-e189d775d780 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20242024-09-05T00:47:35.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42639 req_id = dc2db822-9ec9-41b1-91f4-bb67b299140b response_code = 204 uri = /vpc-routes
20252024-09-05T00:47:35.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54632
20262024-09-05T00:47:35.335ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4201fb72-62c9-4bc9-b4fd-ee3284095ee8, kind: Service { id: 145d6d08-bb1c-4557-af3d-b3b8e647b114 }, name: Name("external-dns-145d6d08-bb1c-4557-af3d-b3b8e647b114"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 139])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60a23721-fd77-4d33-a0a4-0735bb775681, kind: Service { id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b }, name: Name("external-dns-4aa18504-a7e8-4aa1-94fe-a65abab62a4b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03971845-77e2-4239-964a-04e9c3f9d11e, kind: Service { id: c8b7e56a-4fd1-4100-8ded-5a17ea178a46 }, name: Name("nexus-c8b7e56a-4fd1-4100-8ded-5a17ea178a46"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9f0144bd-0194-4864-a015-629f3aebd42c, kind: Service { id: 7171adea-be80-48c5-a65b-fe3a55b4870d }, name: Name("nexus-7171adea-be80-48c5-a65b-fe3a55b4870d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc066fb6-a099-4780-b3f0-61b984118b4f, kind: Service { id: 5f1fb376-349f-4b39-808a-5aa5abc60b1e }, name: Name("nexus-5f1fb376-349f-4b39-808a-5aa5abc60b1e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 225])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20272024-09-05T00:47:35.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20282024-09-05T00:47:35.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20292024-09-05T00:47:35.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20302024-09-05T00:47:35.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
20312024-09-05T00:47:35.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20322024-09-05T00:47:35.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20332024-09-05T00:47:35.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54632 req_id = 095fe5eb-1d4e-43a4-8271-555b4facf8e9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20342024-09-05T00:47:35.355ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
20352024-09-05T00:47:35.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 123057 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56087 req_id = 69072e41-206f-42fc-a8dc-205df1f15fde response_code = 204 uri = /switch-ports
20362024-09-05T00:47:35.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56087 req_id = 9d17fd03-293d-4f7f-861f-cecf47b51f60 response_code = 200 uri = /network-bootstore-config
20372024-09-05T00:47:35.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57505
20382024-09-05T00:47:35.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57505 req_id = eef23315-f9fe-424f-be0a-d09c20ffd6a6 response_code = 200 uri = /v2p
20392024-09-05T00:47:35.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34241
20402024-09-05T00:47:35.518ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
20412024-09-05T00:47:35.556ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
20422024-09-05T00:47:35.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91675 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34241 req_id = ee1efc63-6416-4b13-a26c-58891d386b16 response_code = 204 uri = /switch-ports
20432024-09-05T00:47:35.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57384
20442024-09-05T00:47:35.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34241 req_id = 07e45958-dda7-4932-bb5e-7c3b409edc58 response_code = 200 uri = /network-bootstore-config
20452024-09-05T00:47:35.611ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4201fb72-62c9-4bc9-b4fd-ee3284095ee8, kind: Service { id: 145d6d08-bb1c-4557-af3d-b3b8e647b114 }, name: Name("external-dns-145d6d08-bb1c-4557-af3d-b3b8e647b114"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 139])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60a23721-fd77-4d33-a0a4-0735bb775681, kind: Service { id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b }, name: Name("external-dns-4aa18504-a7e8-4aa1-94fe-a65abab62a4b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 03971845-77e2-4239-964a-04e9c3f9d11e, kind: Service { id: c8b7e56a-4fd1-4100-8ded-5a17ea178a46 }, name: Name("nexus-c8b7e56a-4fd1-4100-8ded-5a17ea178a46"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9f0144bd-0194-4864-a015-629f3aebd42c, kind: Service { id: 7171adea-be80-48c5-a65b-fe3a55b4870d }, name: Name("nexus-7171adea-be80-48c5-a65b-fe3a55b4870d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc066fb6-a099-4780-b3f0-61b984118b4f, kind: Service { id: 5f1fb376-349f-4b39-808a-5aa5abc60b1e }, name: Name("nexus-5f1fb376-349f-4b39-808a-5aa5abc60b1e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 225])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20462024-09-05T00:47:35.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20472024-09-05T00:47:35.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20482024-09-05T00:47:35.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20492024-09-05T00:47:35.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
20502024-09-05T00:47:35.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20512024-09-05T00:47:35.611ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20522024-09-05T00:47:35.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1021 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57384 req_id = 7b21ab59-5f57-48a1-ad32-cb2ae3cb3863 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20532024-09-05T00:47:40.345ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6028 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = 8d73513b-0f62-4a24-b9cb-13ae8946f84f response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
20542024-09-05T00:48:03.237ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38370
20552024-09-05T00:48:03.237ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38370 req_id = 6d377232-6832-472d-93ad-9ac6464dadd0 response_code = 200 uri = /baseboard
20562024-09-05T00:48:04.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42503
20572024-09-05T00:48:04.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42503 req_id = 108a2b76-2607-4dd8-9141-249f1f2731ed response_code = 200 uri = /vpc-routes
20582024-09-05T00:48:04.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42503 req_id = e9ad9942-7a70-46ab-8396-d771a23763b5 response_code = 204 uri = /vpc-routes
20592024-09-05T00:48:04.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52563
20602024-09-05T00:48:04.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52563 req_id = 4c2eafbb-4479-4014-a9dd-902baedf1f07 response_code = 200 uri = /vpc-routes
20612024-09-05T00:48:04.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52563 req_id = 06d8af7a-651a-4c3f-b4ce-8f1e6fe4578f response_code = 204 uri = /vpc-routes
20622024-09-05T00:48:04.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63359
20632024-09-05T00:48:04.855ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
20642024-09-05T00:48:04.894ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
20652024-09-05T00:48:04.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63359 req_id = 67dbbee6-fe27-47da-bcb7-aa97f9d999a6 response_code = 204 uri = /switch-ports
20662024-09-05T00:48:04.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35133
20672024-09-05T00:48:04.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37295
20682024-09-05T00:48:04.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63359 req_id = 0fe92909-36cc-48d6-8036-9b2256f45974 response_code = 200 uri = /network-bootstore-config
20692024-09-05T00:48:04.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35133 req_id = e22f750b-d978-4f6b-88ba-59c23ea06048 response_code = 200 uri = /v2p
20702024-09-05T00:48:04.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37295 req_id = a2308b87-5c7b-4ca7-beb7-aa22aa8def65 response_code = 200 uri = /v2p
20712024-09-05T00:48:04.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35200
20722024-09-05T00:48:04.981ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
20732024-09-05T00:48:05.028ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
20742024-09-05T00:48:05.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111830 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35200 req_id = 9f723bd4-7727-41fd-872c-631a36f9d882 response_code = 204 uri = /switch-ports
20752024-09-05T00:48:05.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35200 req_id = 9878d210-cd07-479e-8f32-03691cbaab65 response_code = 200 uri = /network-bootstore-config
20762024-09-05T00:48:05.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65015
20772024-09-05T00:48:05.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65015 req_id = b79170ed-b675-471f-a6e8-c1e9fef78b21 response_code = 200 uri = /vpc-routes
20782024-09-05T00:48:05.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65015 req_id = 00b653d8-f4d9-4b4e-ab23-625f241de9b7 response_code = 204 uri = /vpc-routes
20792024-09-05T00:48:05.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39840
20802024-09-05T00:48:05.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 645 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39840 req_id = 330d9eb9-4064-483f-9376-56b3bc0dc8c5 response_code = 200 uri = /v2p
20812024-09-05T00:48:05.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41295
20822024-09-05T00:48:05.280ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
20832024-09-05T00:48:05.317ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
20842024-09-05T00:48:05.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94603 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41295 req_id = 3fb4eb42-ff8f-4aaa-ad31-96d1a2a461bf response_code = 204 uri = /switch-ports
20852024-09-05T00:48:05.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41295 req_id = b74872bb-fada-40e2-9bfb-eec3ef13314d response_code = 200 uri = /network-bootstore-config
20862024-09-05T00:48:10.345ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6819 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = 60546c02-fa83-4bad-93d5-3b9bf7fbbc23 response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
20872024-09-05T00:48:33.271ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64356
20882024-09-05T00:48:33.271ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64356 req_id = 34c18c3d-17cd-46dc-9073-888f3f7dfb8f response_code = 200 uri = /baseboard
20892024-09-05T00:48:34.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35626
20902024-09-05T00:48:34.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35626 req_id = 6d54e062-db6c-4694-ba88-bf43a4975eb8 response_code = 200 uri = /vpc-routes
20912024-09-05T00:48:34.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35626 req_id = 9abeac23-04b3-4d8a-b977-ee2413d16e30 response_code = 204 uri = /vpc-routes
20922024-09-05T00:48:34.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42618
20932024-09-05T00:48:34.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42618 req_id = d410326d-da22-48d4-96f1-d45242bcab7e response_code = 200 uri = /vpc-routes
20942024-09-05T00:48:34.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42618 req_id = 253cca4b-6e07-486a-91ef-13af70b3e600 response_code = 204 uri = /vpc-routes
20952024-09-05T00:48:35.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45924
20962024-09-05T00:48:35.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45924 req_id = e8adda27-f1fc-4e8f-ae1d-f96e541ff6fb response_code = 200 uri = /v2p
20972024-09-05T00:48:35.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49069
20982024-09-05T00:48:35.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49069 req_id = d489a63b-c05b-478a-992b-962c47b787f6 response_code = 200 uri = /v2p
20992024-09-05T00:48:35.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55872
21002024-09-05T00:48:35.089ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
21012024-09-05T00:48:35.129ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
21022024-09-05T00:48:35.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97605 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55872 req_id = 543fa60a-8100-4047-bb7e-a8938453c315 response_code = 204 uri = /switch-ports
21032024-09-05T00:48:35.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55872 req_id = b54fddfc-665a-4f25-af64-bdccfe561438 response_code = 200 uri = /network-bootstore-config
21042024-09-05T00:48:35.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63214
21052024-09-05T00:48:35.260ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
21062024-09-05T00:48:35.293ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
21072024-09-05T00:48:35.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91024 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63214 req_id = efa26ae3-2cd2-46d1-9a69-141fb390b929 response_code = 204 uri = /switch-ports
21082024-09-05T00:48:35.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43340
21092024-09-05T00:48:35.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57091
21102024-09-05T00:48:35.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43340 req_id = 69da40c2-59fd-4ab2-8155-fa05c55cb96b response_code = 200 uri = /v2p
21112024-09-05T00:48:35.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1003 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57091 req_id = 0d04d7b3-8810-4db5-93cc-690be044c84b response_code = 200 uri = /vpc-routes
21122024-09-05T00:48:35.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63214 req_id = 1da6cbd1-f90d-4a31-9c44-9f8ba70daba0 response_code = 200 uri = /network-bootstore-config
21132024-09-05T00:48:35.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57091 req_id = feed9a17-f9d2-4187-846f-1c19e16cb061 response_code = 204 uri = /vpc-routes
21142024-09-05T00:48:35.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59822
21152024-09-05T00:48:35.534ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
21162024-09-05T00:48:35.571ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
21172024-09-05T00:48:35.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92931 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59822 req_id = d7a7cdd2-7621-4136-8e84-32c731f428fc response_code = 204 uri = /switch-ports
21182024-09-05T00:48:35.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59822 req_id = d2d2a008-f65a-4663-a032-3f897db245ce response_code = 200 uri = /network-bootstore-config
21192024-09-05T00:48:40.457ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5783 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = bfe8037d-511e-420f-9c42-ce8d71a583f5 response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
21202024-09-05T00:49:01.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48730
21212024-09-05T00:49:01.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48730 req_id = e12d6672-30eb-4fdf-a3b5-35ad7cc34090 response_code = 200 uri = /v2p
21222024-09-05T00:49:01.091ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:778 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 241, 117, 70])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(15632793) }
21232024-09-05T00:49:01.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 532 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48730 req_id = 747d87d7-aad0-40d0-9436-bf15cd52148f response_code = 204 uri = /v2p
21242024-09-05T00:49:01.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35805
21252024-09-05T00:49:01.211ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:570 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 9d723da7-8aeb-4dc6-8181-2e29e8ae80f7, kind: Instance { id: 4ff1e132-d479-46d8-a4e0-3ec93be9d815 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 117, 70])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15632793), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9d723da7-8aeb-4dc6-8181-2e29e8ae80f7, kind: Instance { id: 4ff1e132-d479-46d8-a4e0-3ec93be9d815 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 117, 70])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15632793), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9d723da7-8aeb-4dc6-8181-2e29e8ae80f7, kind: Instance { id: 4ff1e132-d479-46d8-a4e0-3ec93be9d815 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 117, 70])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15632793), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15632793))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9d723da7-8aeb-4dc6-8181-2e29e8ae80f7, kind: Instance { id: 4ff1e132-d479-46d8-a4e0-3ec93be9d815 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 117, 70])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15632793), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-71314bd888a", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 65dc30d3-2723-4e3e-b9fe-01e655a289a2, read_only_parent: Some(Volume { block_size: 512, id: 0fab9312-b026-418d-8945-19002cdf7bd3, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 0ec96f3a-4bfc-454a-80e8-5fd4bb0db3a0, key: Some("C5ueyYmrs8ybuQgI3VMfj68ldp6npfLL4As+6Nwbkvo="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 65dc30d3-2723-4e3e-b9fe-01e655a289a2, key: Some("leE5glsUbiumPZcWHeMTHtkznQHW+Jhq2SZlNyuDKPw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::18]:19000"] } }] } }], cloud_init_bytes: Some(..) } instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 instance_runtime = InstanceRuntimeState { propolis_id: Some(74d206fd-7b85-46a8-90a5-4557f96d3a63 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-09-05T00:49:00.694215500Z } metadata = InstanceMetadata { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, project_id: 43eeffc2-5843-4008-bed9-ec069e561096 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-09-05T00:49:00.635406Z }
21262024-09-05T00:49:01.212ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:603 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21272024-09-05T00:49:01.212ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:991 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 migration_id = None propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 9d723da7-8aeb-4dc6-8181-2e29e8ae80f7, kind: Instance { id: 4ff1e132-d479-46d8-a4e0-3ec93be9d815 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 117, 70])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15632793), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9d723da7-8aeb-4dc6-8181-2e29e8ae80f7, kind: Instance { id: 4ff1e132-d479-46d8-a4e0-3ec93be9d815 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 117, 70])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15632793), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9d723da7-8aeb-4dc6-8181-2e29e8ae80f7, kind: Instance { id: 4ff1e132-d479-46d8-a4e0-3ec93be9d815 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 117, 70])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15632793), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15632793))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9d723da7-8aeb-4dc6-8181-2e29e8ae80f7, kind: Instance { id: 4ff1e132-d479-46d8-a4e0-3ec93be9d815 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 117, 70])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15632793), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-71314bd888a", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 65dc30d3-2723-4e3e-b9fe-01e655a289a2, read_only_parent: Some(Volume { block_size: 512, id: 0fab9312-b026-418d-8945-19002cdf7bd3, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 0ec96f3a-4bfc-454a-80e8-5fd4bb0db3a0, key: Some("C5ueyYmrs8ybuQgI3VMfj68ldp6npfLL4As+6Nwbkvo="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 65dc30d3-2723-4e3e-b9fe-01e655a289a2, key: Some("leE5glsUbiumPZcWHeMTHtkznQHW+Jhq2SZlNyuDKPw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::18]:19000"] } }] } }], cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-09-05T00:49:00.635406Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
21282024-09-05T00:49:01.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 15984 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35805 req_id = bfa8378e-7a39-4013-b7ff-50f6973592d6 response_code = 200 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
21292024-09-05T00:49:01.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39988
21302024-09-05T00:49:01.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 681 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39988 req_id = 4226d5d4-90b4-41cf-80f0-8b4b5ef6c4dc response_code = 200 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63/state
21312024-09-05T00:49:01.338ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 241, 117, 70]), slot: 0, vni: Vni { inner: 15632793 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
21322024-09-05T00:49:01.338ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
21332024-09-05T00:49:01.374ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63 file = illumos-utils/src/zone.rs:316 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21342024-09-05T00:49:01.400ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63 file = illumos-utils/src/zone.rs:354 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21352024-09-05T00:49:02.627ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21362024-09-05T00:49:02.628ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 zone = oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63
21372024-09-05T00:49:02.811ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63") failed: Property not found. retry in 55.322875ms file = illumos-utils/src/svc.rs:36 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 zone = oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63
21382024-09-05T00:49:02.880ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63") failed: Property not found. retry in 100.029425ms file = illumos-utils/src/svc.rs:36 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 zone = oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63
21392024-09-05T00:49:02.996ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63") failed: Property not found. retry in 137.55183ms file = illumos-utils/src/svc.rs:36 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 zone = oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63
21402024-09-05T00:49:03.150ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63") failed: Property not found. retry in 472.439491ms file = illumos-utils/src/svc.rs:36 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 zone = oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63
21412024-09-05T00:49:03.319ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40914
21422024-09-05T00:49:03.319ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40914 req_id = 1d8e3dd8-7f3e-46a8-bd71-d8181068b8ee response_code = 200 uri = /baseboard
21432024-09-05T00:49:03.639ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63") failed: Property not found. retry in 936.067172ms file = illumos-utils/src/svc.rs:36 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 zone = oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63
21442024-09-05T00:49:04.591ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63") failed: Property not found. retry in 1.495940441s file = illumos-utils/src/svc.rs:36 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 zone = oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63
21452024-09-05T00:49:04.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41609
21462024-09-05T00:49:04.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41609 req_id = 46dfaad7-e894-48ba-9738-bbe2c196641b response_code = 200 uri = /vpc-routes
21472024-09-05T00:49:04.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41265
21482024-09-05T00:49:04.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41265 req_id = 3064fda0-7cf8-49db-958f-c0a594a77dad response_code = 200 uri = /vpc-routes
21492024-09-05T00:49:04.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55122
21502024-09-05T00:49:04.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35439
21512024-09-05T00:49:04.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49042
21522024-09-05T00:49:04.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49042 req_id = 155701c4-0ec7-4978-b462-55f495ebb0f6 response_code = 200 uri = /v2p
21532024-09-05T00:49:04.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51106
21542024-09-05T00:49:04.887ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
21552024-09-05T00:49:04.926ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
21562024-09-05T00:49:04.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 107761 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51106 req_id = 0db77f90-f960-4a2d-9f20-a4924d89f178 response_code = 204 uri = /switch-ports
21572024-09-05T00:49:04.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39228
21582024-09-05T00:49:04.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60196
21592024-09-05T00:49:04.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51106 req_id = c4efa366-dcea-416b-a305-bde4d9ce032d response_code = 200 uri = /network-bootstore-config
21602024-09-05T00:49:04.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 437 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60196 req_id = 0498df24-dc6d-4a28-990c-d38d0446a283 response_code = 200 uri = /v2p
21612024-09-05T00:49:04.996ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
21622024-09-05T00:49:04.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 558 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41265 req_id = 725706e6-5a13-4887-8a04-ea6d80ddb5fd response_code = 204 uri = /vpc-routes
21632024-09-05T00:49:04.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 696 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41609 req_id = 1cd7b63c-7052-4ac8-87a6-fb0b14e4ed96 response_code = 204 uri = /vpc-routes
21642024-09-05T00:49:05.049ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
21652024-09-05T00:49:05.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 115962 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39228 req_id = 8da4310b-6c5b-469c-b6fa-d1bbe161cf12 response_code = 204 uri = /switch-ports
21662024-09-05T00:49:05.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39228 req_id = 2e6e4f3b-8928-4ce3-bbfc-6ef01e0173c8 response_code = 200 uri = /network-bootstore-config
21672024-09-05T00:49:05.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61160
21682024-09-05T00:49:05.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61160 req_id = 5a08917b-8f5b-49d8-8b1f-a6f4df283555 response_code = 200 uri = /vpc-routes
21692024-09-05T00:49:05.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61686
21702024-09-05T00:49:05.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61160 req_id = 14ec121e-fd57-4536-9174-c8939912558d response_code = 204 uri = /vpc-routes
21712024-09-05T00:49:05.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35288
21722024-09-05T00:49:05.371ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4014
21732024-09-05T00:49:05.408ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4038
21742024-09-05T00:49:05.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93609 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35288 req_id = 4cffa400-07f3-4c95-b8a8-a5cce24c40f6 response_code = 204 uri = /switch-ports
21752024-09-05T00:49:05.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40696
21762024-09-05T00:49:05.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40696 req_id = caca59b4-6b8c-41db-a6cc-2d76b64ad853 response_code = 200 uri = /v2p
21772024-09-05T00:49:05.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35288 req_id = ab172e82-7220-436b-8b5a-5472cb6d9aa6 response_code = 200 uri = /network-bootstore-config
21782024-09-05T00:49:06.098ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63") failed: Property not found. retry in 1.475709471s file = illumos-utils/src/svc.rs:36 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 zone = oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63
21792024-09-05T00:49:07.584ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63") failed: Property not found. retry in 831.68963ms file = illumos-utils/src/svc.rs:36 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 zone = oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63
21802024-09-05T00:49:08.448ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63 file = sled-agent/src/instance.rs:1449 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21812024-09-05T00:49:08.457ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63") failed: Property not found. retry in 53.363049ms file = illumos-utils/src/svc.rs:36 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21822024-09-05T00:49:08.520ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63") failed: Property not found. retry in 101.792496ms file = illumos-utils/src/svc.rs:36 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21832024-09-05T00:49:08.632ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63") failed: Property not found. retry in 213.348656ms file = illumos-utils/src/svc.rs:36 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21842024-09-05T00:49:08.855ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1458 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21852024-09-05T00:49:08.894ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1482 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21862024-09-05T00:49:09.034ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:727 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21872024-09-05T00:49:09.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4237328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35439 req_id = 29c4588b-a911-4ac5-b33f-f8c6b685cbe4 response_code = 200 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63/state
21882024-09-05T00:49:09.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3706679 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61686 req_id = 6194cbef-a56c-4743-85a3-3bd8570758bd response_code = 200 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63/state
21892024-09-05T00:49:09.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4245166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55122 req_id = 83fc37d0-b9cc-452e-b714-00233dd71564 response_code = 200 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63/state
21902024-09-05T00:49:09.037ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-09-05T00:49:09.037122719Z } file = sled-agent/src/instance.rs:594 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21912024-09-05T00:49:09.037ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-09-05T00:49:09.037122719Z } propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21922024-09-05T00:49:09.037ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-09-05T00:49:09.037122719Z }, migration_in: None, migration_out: None }
21932024-09-05T00:49:09.095ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-09-05T00:49:09.095382376Z } file = sled-agent/src/instance.rs:594 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21942024-09-05T00:49:09.095ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-09-05T00:49:09.095382376Z } propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
21952024-09-05T00:49:09.095ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-09-05T00:49:09.095382376Z }, migration_in: None, migration_out: None }
21962024-09-05T00:49:10.458ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6538 local_addr = [fd00:1122:3344:101::1]:33551 method = GET remote_addr = [fd00:1122:3344:101::d]:62182 req_id = edc6a7c0-dfec-4a13-a552-cabe235277de response_code = 200 sled_id = a014d257-275c-449e-a4f4-aef00eab141c uri = /a014d257-275c-449e-a4f4-aef00eab141c
21972024-09-05T00:49:18.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62865
21982024-09-05T00:49:18.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 497 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62865 req_id = 82647d78-3868-4957-bfed-ac0fd506b6f9 response_code = 200 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63/state
21992024-09-05T00:49:18.910ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-09-05T00:49:18.910818461Z } file = sled-agent/src/instance.rs:594 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
22002024-09-05T00:49:18.910ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-09-05T00:49:18.910818461Z } propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
22012024-09-05T00:49:18.910ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-09-05T00:49:18.910818461Z }, migration_in: None, migration_out: None }
22022024-09-05T00:49:18.937ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-09-05T00:49:18.937199521Z } file = sled-agent/src/instance.rs:594 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
22032024-09-05T00:49:18.937ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-09-05T00:49:18.937199521Z } propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
22042024-09-05T00:49:18.937ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:630 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
22052024-09-05T00:49:18.937ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
22062024-09-05T00:49:18.938ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:557 id = 7185110405698409353 n_samples = 6 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
22072024-09-05T00:49:18.939ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:557 id = 5001840512508426591 n_samples = 6 sled_id = a014d257-275c-449e-a4f4-aef00eab141c
22082024-09-05T00:49:18.939ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
22092024-09-05T00:49:18.939ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/2455a9c8-fd1a-4dff-b957-96f508caa645/debug/bundle/zone", "/pool/int/f56f8b7a-9e3d-4f05-aa96-9f0f15e43c8c/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/07758950-4365-4426-bdcd-a3906ef0719c/crypt/debug", "/pool/ext/3149c6f5-adf9-4e42-9a6f-ea817157070d/crypt/debug", "/pool/ext/47f9ab94-cb52-4abd-b519-311e83310dbb/crypt/debug", "/pool/ext/cd6b3ed7-21c7-4782-a335-8ab89ee4c355/crypt/debug", "/pool/ext/5e93ddc1-113d-4d72-b455-60d0ee285e5b/crypt/debug", "/pool/ext/0992886b-7bd4-4261-afe1-662fbe130da8/crypt/debug", "/pool/ext/3b890830-afe5-4534-9d63-2368c96a17b2/crypt/debug", "/pool/ext/f4d0c62d-ea23-4f6c-a7fd-af646b395599/crypt/debug", "/pool/ext/18c638cc-0eb0-43bd-9ec4-4ccc7a05322e/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63
22102024-09-05T00:49:19.576ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1137 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63", bundle_id: b95a4842-1760-4d5c-9c5a-6d530ff274f1 }, time_created: 2024-09-05T00:49:18.940024041Z, version: 0, cause: TerminatedInstance }
22112024-09-05T00:49:19.576ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_74d206fd-7b85-46a8-90a5-4557f96d3a63 file = sled-agent/src/instance.rs:826 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
22122024-09-05T00:49:21.329ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:270 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
22132024-09-05T00:49:21.344ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:904 id = RouterId { vni: Vni(15632793), kind: System }
22142024-09-05T00:49:21.344ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:904 id = RouterId { vni: Vni(15632793), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
22152024-09-05T00:49:21.346ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-09-05T00:49:21.345972414Z }, migration_in: None, migration_out: None }
22162024-09-05T00:49:21.380ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-09-05T00:49:21.345972414Z }, migration_in: None, migration_out: None }
22172024-09-05T00:49:21.386ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:763 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63
22182024-09-05T00:49:21.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51663
22192024-09-05T00:49:21.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51663 req_id = 9c01201a-7823-401c-aa3f-a5cc747af872 response_code = 200 uri = /v2p
22202024-09-05T00:49:21.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53645
22212024-09-05T00:49:21.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53645 req_id = 33eb139d-f51e-43a6-aec0-20b78bb2869f response_code = 200 uri = /vpc-routes
22222024-09-05T00:49:21.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53645 req_id = 0237057e-de97-4c0f-a7f4-77f391ec87f1 response_code = 204 uri = /vpc-routes
22232024-09-05T00:49:22.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46709
22242024-09-05T00:49:22.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46709 req_id = 03801676-8891-4413-89fc-349adac70413 response_code = 200 uri = /v2p
22252024-09-05T00:49:23.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40158
22262024-09-05T00:49:23.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40158 req_id = 7ffd23b6-2968-4166-8f1c-c991718ef452 response_code = 200 uri = /vpc-routes
22272024-09-05T00:49:23.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40158 req_id = 40d71196-2f5e-449f-8891-c52116c6fa1d response_code = 204 uri = /vpc-routes