Max level shown:
1 [ Sep 23 23:08:45 Enabled. ]
2 [ Sep 23 23:08:45 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Sep 23 23:08:45 Method "start" exited with status 0. ]
4 [ Sep 23 23:08:45 Rereading configuration. ]
5 [ Sep 23 23:08:45 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-09-23T23:08:45.494ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-09-23T23:08:45.494ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-09-23T23:08:45.546ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-09-23T23:08:45.546ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-09-23T23:08:45.661ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-09-23T23:08:45.670ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-09-23T23:08:45.678ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-09-23T23:08:46.279ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-09-23T23:08:46.420ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-09-23T23:08:46.420ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-09-23T23:08:46.420ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-09-23T23:08:46.420ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-09-23T23:08:46.420ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-09-23T23:08:46.420ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:716
212024-09-23T23:08:46.423ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:623
222024-09-23T23:08:46.423ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:765
232024-09-23T23:08:46.423ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-09-23T23:08:46.423ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:824
252024-09-23T23:08:46.423ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-09-23T23:08:46.423ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-09-23T23:08:46.424ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
282024-09-23T23:08:46.424ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-09-23T23:08:46.424ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-09-23T23:08:46.435ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:360
312024-09-23T23:08:46.435ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool)
322024-09-23T23:08:46.569ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:185 zpool = ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal }
332024-09-23T23:08:47.086ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
342024-09-23T23:08:47.086ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-09-23T23:08:47.086ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-09-23T23:08:47.086ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-09-23T23:08:47.086ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
382024-09-23T23:08:47.086ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
392024-09-23T23:08:47.086ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
402024-09-23T23:08:47.086ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
412024-09-23T23:08:47.086ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
422024-09-23T23:08:47.086ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
432024-09-23T23:08:47.096ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:360
442024-09-23T23:08:47.096ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool)
452024-09-23T23:08:47.208ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:185 zpool = ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal }
462024-09-23T23:08:47.738ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
472024-09-23T23:08:47.738ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
482024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
492024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
502024-09-23T23:08:47.738ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
512024-09-23T23:08:47.738ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
522024-09-23T23:08:47.738ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
532024-09-23T23:08:47.738ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
542024-09-23T23:08:47.738ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
552024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
562024-09-23T23:08:47.738ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
572024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
582024-09-23T23:08:47.738ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
592024-09-23T23:08:47.738ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
602024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
612024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
622024-09-23T23:08:47.738ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
632024-09-23T23:08:47.738ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
642024-09-23T23:08:47.738ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
652024-09-23T23:08:47.738ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
662024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
672024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
682024-09-23T23:08:47.738ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
692024-09-23T23:08:47.738ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
702024-09-23T23:08:47.738ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
712024-09-23T23:08:47.738ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
722024-09-23T23:08:47.738ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
732024-09-23T23:08:47.738ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
742024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
752024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
762024-09-23T23:08:47.738ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
772024-09-23T23:08:47.738ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
782024-09-23T23:08:47.738ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-09-23T23:08:47.738ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
802024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
812024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
822024-09-23T23:08:47.738ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-09-23T23:08:47.738ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
852024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862024-09-23T23:08:47.738ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
872024-09-23T23:08:47.738ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
882024-09-23T23:08:47.738ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
892024-09-23T23:08:47.738ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
902024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-09-23T23:08:47.738ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
932024-09-23T23:08:47.738ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
942024-09-23T23:08:47.738ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
952024-09-23T23:08:47.738ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
962024-09-23T23:08:47.738ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972024-09-23T23:08:47.738ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
982024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
992024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1002024-09-23T23:08:47.738ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
1012024-09-23T23:08:47.738ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1022024-09-23T23:08:47.738ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1032024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1042024-09-23T23:08:47.738ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1052024-09-23T23:08:47.738ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1062024-09-23T23:08:47.738ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1072024-09-23T23:08:47.738ZINFOSledAgent (bootstore): No ledger in /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-09-23T23:08:47.738ZINFOSledAgent (bootstore): No ledger in /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-09-23T23:08:47.738ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1102024-09-23T23:08:47.738ZINFOSledAgent (bootstore): No ledger in /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1112024-09-23T23:08:47.738ZINFOSledAgent (bootstore): No ledger in /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1122024-09-23T23:08:47.738ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1132024-09-23T23:08:47.738ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1142024-09-23T23:08:47.738ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1152024-09-23T23:08:47.749ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1162024-09-23T23:08:47.750ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1326, tv_nsec: 739847933 } time_to_next_cleanup = 599.999926149s
1172024-09-23T23:08:47.750ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3917
1182024-09-23T23:08:47.750ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1192024-09-23T23:08:47.750ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/sled-agent-request.json file = common/src/ledger.rs:188
1202024-09-23T23:08:47.752ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/sled-agent-request.json file = common/src/ledger.rs:188
1212024-09-23T23:08:47.753ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1222024-09-23T23:08:47.754ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1232024-09-23T23:08:47.755ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, local_pref: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1074
1242024-09-23T23:08:47.755ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
1252024-09-23T23:08:47.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1262024-09-23T23:08:47.755ZINFOSledAgent (RSS): No ledger in /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-09-23T23:08:47.755ZINFOSledAgent (RSS): No ledger in /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-09-23T23:08:47.755ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1137
1292024-09-23T23:08:47.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1302024-09-23T23:08:47.755ZINFOSledAgent (RSS): No ledger in /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/rss-sled-plan.json file = common/src/ledger.rs:188
1312024-09-23T23:08:47.755ZINFOSledAgent (RSS): No ledger in /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/rss-sled-plan.json file = common/src/ledger.rs:188
1322024-09-23T23:08:47.755ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1179
1332024-09-23T23:08:47.755ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:155
1342024-09-23T23:08:47.755ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:128
1352024-09-23T23:08:47.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1362024-09-23T23:08:47.755ZINFOSledAgent (RSS): Writing ledger to /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1372024-09-23T23:08:47.755ZINFOSledAgent (RSS): Writing ledger to /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1382024-09-23T23:08:47.756ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: a6cfeab5-1bcd-4180-8b80-d27bd607042d, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, local_pref: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:175
1392024-09-23T23:08:47.756ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1213
1402024-09-23T23:08:47.756ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1412024-09-23T23:08:47.756ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1422024-09-23T23:08:47.756ZINFOSledAgent (bootstore): Writing ledger to /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1432024-09-23T23:08:47.756ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1442024-09-23T23:08:47.756ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: a6cfeab5-1bcd-4180-8b80-d27bd607042d, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1452024-09-23T23:08:47.757ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4214
1462024-09-23T23:08:47.757ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4596
1472024-09-23T23:08:47.761ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1482024-09-23T23:08:47.767ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1492024-09-23T23:08:47.768ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1502024-09-23T23:08:47.772ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1512024-09-23T23:08:47.772ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1522024-09-23T23:08:47.772ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:44836
1532024-09-23T23:08:47.773ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: a6cfeab5-1bcd-4180-8b80-d27bd607042d, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:361
1542024-09-23T23:08:47.773ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:376
1552024-09-23T23:08:47.773ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1562024-09-23T23:08:47.773ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:451
1572024-09-23T23:08:47.773ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:644
1582024-09-23T23:08:47.773ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
1592024-09-23T23:08:47.773ZINFOSledAgent (StorageManager): No ledger in /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1602024-09-23T23:08:47.773ZINFOSledAgent (StorageManager): No ledger in /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1612024-09-23T23:08:47.773ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:633
1622024-09-23T23:08:47.773ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:661
1632024-09-23T23:08:47.773ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1642024-09-23T23:08:47.773ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:440
1652024-09-23T23:08:47.773ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1662024-09-23T23:08:47.773ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:532 result = DisksManagementResult { status: [] }
1672024-09-23T23:08:47.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1682024-09-23T23:08:47.810ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:316
1692024-09-23T23:08:47.823ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:391 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
1702024-09-23T23:08:47.823ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1712024-09-23T23:08:47.823ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:403 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
1722024-09-23T23:08:47.823ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1732024-09-23T23:08:47.826ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 54.38135ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "12af1982-c82a-4095-8eea-b4c16a0dc91d", "content-length": "124", "date": "Mon, 23 Sep 2024 23:08:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "12af1982-c82a-4095-8eea-b4c16a0dc91d" } file = clients/ddm-admin-client/src/lib.rs:177
1742024-09-23T23:08:47.827ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1752024-09-23T23:08:47.836ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_7073a935-f8ba-4ac8-91ff-452f67ec46db/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1762024-09-23T23:08:47.867ZINFOSledAgent: successfully created encrypted zvol: name="oxi_7073a935-f8ba-4ac8-91ff-452f67ec46db/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1772024-09-23T23:08:47.867ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_7073a935-f8ba-4ac8-91ff-452f67ec46db/swap" file = sled-agent/src/swap_device.rs:96
1782024-09-23T23:08:47.872ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:418 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
1792024-09-23T23:08:47.872ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:130
1802024-09-23T23:08:47.872ZINFOSledAgent (BackingFs): Ensuring dataset oxi_7073a935-f8ba-4ac8-91ff-452f67ec46db/backing/fmd file = sled-agent/src/backing_fs.rs:140
1812024-09-23T23:08:47.882ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-09-23T23:08:47.883ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 114.362157ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7e524b9e-9328-4b67-a250-984552274aac", "content-length": "124", "date": "Mon, 23 Sep 2024 23:08:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7e524b9e-9328-4b67-a250-984552274aac" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-09-23T23:08:47.976ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:175
1842024-09-23T23:08:47.998ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1852024-09-23T23:08:47.999ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 200.272735ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3631f02f-fb1e-4a6e-89b2-cefce4c2b732", "content-length": "124", "date": "Mon, 23 Sep 2024 23:08:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3631f02f-fb1e-4a6e-89b2-cefce4c2b732" } file = clients/ddm-admin-client/src/lib.rs:177
1862024-09-23T23:08:48.196ZINFOSledAgent (BackingFs): Mounting oxi_7073a935-f8ba-4ac8-91ff-452f67ec46db/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:183
1872024-09-23T23:08:48.201ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-09-23T23:08:48.201ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 213.195512ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "25cdbea3-3556-4a82-a0aa-d2c65b42174b", "content-length": "124", "date": "Mon, 23 Sep 2024 23:08:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "25cdbea3-3556-4a82-a0aa-d2c65b42174b" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-09-23T23:08:48.210ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:191
1902024-09-23T23:08:48.210ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:191
1912024-09-23T23:08:48.210ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:191
1922024-09-23T23:08:48.210ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:197
1932024-09-23T23:08:48.416ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1942024-09-23T23:08:48.417ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 223.33656ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5cbe8900-540c-4aee-999f-a31a6f205fc6", "content-length": "124", "date": "Mon, 23 Sep 2024 23:08:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5cbe8900-540c-4aee-999f-a31a6f205fc6" } file = clients/ddm-admin-client/src/lib.rs:177
1952024-09-23T23:08:48.641ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1962024-09-23T23:08:48.642ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 364.283399ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3f95236b-d9d4-4c83-937c-dcfd05db7518", "content-length": "124", "date": "Mon, 23 Sep 2024 23:08:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3f95236b-d9d4-4c83-937c-dcfd05db7518" } file = clients/ddm-admin-client/src/lib.rs:177
1972024-09-23T23:08:48.960ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
1982024-09-23T23:08:48.966ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:55701 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
1992024-09-23T23:08:48.966ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2002024-09-23T23:08:48.966ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:55701 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2012024-09-23T23:08:48.967ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 301.409945ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2022024-09-23T23:08:48.968ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2032024-09-23T23:08:48.968ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2042024-09-23T23:08:48.968ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2052024-09-23T23:08:48.968ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
2062024-09-23T23:08:49.007ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2072024-09-23T23:08:49.270ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 529.29573ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2082024-09-23T23:08:49.801ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.023454144s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2092024-09-23T23:08:50.826ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.462482942s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2102024-09-23T23:08:51.374ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2670
2112024-09-23T23:08:51.374ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2888
2122024-09-23T23:08:51.374ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2540
2132024-09-23T23:08:51.374ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2587
2142024-09-23T23:08:51.374ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2969
2152024-09-23T23:08:51.374ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3011
2162024-09-23T23:08:51.376ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2813
2172024-09-23T23:08:51.378ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2581
2182024-09-23T23:08:51.378ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='fd52d736-9d37-4f7f-81ce-c956fa9f23e3'/> <propval type="astring" name="rack_id" value='20416e3d-a221-481f-9784-cbbcea3a72c8'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fed6:8c82'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='a6cfeab5-1bcd-4180-8b80-d27bd607042d'/> <propval type="astring" name="rack_id" value='20416e3d-a221-481f-9784-cbbcea3a72c8'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='a6cfeab5-1bcd-4180-8b80-d27bd607042d'/> <propval type="astring" name="rack_uuid" value='20416e3d-a221-481f-9784-cbbcea3a72c8'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='a6cfeab5-1bcd-4180-8b80-d27bd607042d'/> <propval type="astring" name="rack_uuid" value='20416e3d-a221-481f-9784-cbbcea3a72c8'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2192024-09-23T23:08:51.378ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2202024-09-23T23:08:51.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 70.40235ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-09-23T23:08:51.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 78.485978ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-09-23T23:08:52.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 274.424451ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-09-23T23:08:52.290ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.560773901s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2242024-09-23T23:08:52.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 591.079799ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-09-23T23:08:53.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 570.184775ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-09-23T23:08:53.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 560.532772ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-09-23T23:08:54.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.043204044s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-09-23T23:08:55.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 718.790248ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-09-23T23:08:55.852ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 7.062304455s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2302024-09-23T23:08:56.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 717.242467ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2312024-09-23T23:08:57.422ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:12345
2322024-09-23T23:08:57.422ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:431
2332024-09-23T23:08:57.422ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2342024-09-23T23:08:57.422ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-09-23T23:08:57.422ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-09-23T23:08:57.423ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2372024-09-23T23:08:57.423ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, local_pref: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None }], bgp: [], bfd: [] })))
2382024-09-23T23:08:57.423ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3917
2392024-09-23T23:08:57.423ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:44836
2402024-09-23T23:08:57.656ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2412024-09-23T23:08:57.656ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2422024-09-23T23:08:57.657ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2432024-09-23T23:08:57.657ZINFOSledAgent (RSS): No ledger in /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/rss-service-plan-v4.json file = common/src/ledger.rs:188
2442024-09-23T23:08:57.657ZINFOSledAgent (RSS): No ledger in /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/rss-service-plan-v4.json file = common/src/ledger.rs:188
2452024-09-23T23:08:57.657ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2462024-09-23T23:08:57.657ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2472024-09-23T23:08:57.657ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2482024-09-23T23:08:57.662ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4238 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2492024-09-23T23:08:57.662ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4254
2502024-09-23T23:08:57.662ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2512024-09-23T23:08:57.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53796
2522024-09-23T23:08:57.902ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2532024-09-23T23:08:57.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53796 req_id = 07825557-4d43-4abd-8199-59856eea7aac response_code = 200 uri = /inventory
2542024-09-23T23:08:57.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46068
2552024-09-23T23:08:57.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46068 req_id = 9ffe4c6e-7959-4a8e-8835-c05a628b3224 response_code = 200 uri = /sled-role
2562024-09-23T23:08:57.933ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2572024-09-23T23:08:57.933ZINFOSledAgent (RSS): Writing ledger to /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/.rss-service-plan-v4.json.tmp file = common/src/ledger.rs:199
2582024-09-23T23:08:57.934ZINFOSledAgent (RSS): Writing ledger to /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/.rss-service-plan-v4.json.tmp file = common/src/ledger.rs:199
2592024-09-23T23:08:57.934ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:1001
2602024-09-23T23:08:57.966ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 24cea942-cbad-4c12-b55d-742656c7a16f, pool_id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e9b1cf31-e3a3-43cf-8ddf-2d16b666c1b0, pool_id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: de916f96-454a-4f89-aaf2-ea71291c0174, pool_id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 7a77aac8-c798-4f49-a8ec-44a0ce07cbf7, pool_id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 446ad3ef-d639-41fe-bbeb-2eea73eeb7d7, pool_id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 5e84b15b-5387-4cd7-9e4c-5adcc412b1ee, pool_id: ce967aab-6630-4925-b90b-9c9cb48e90c0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 4aa1bba4-2f35-4907-8754-1cf5fb57b138, pool_id: fd5ca1dd-39f0-4844-af6b-77dcaa746e9d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1bc21899-4684-4321-ae96-d43ab4310347, pool_id: ef338e61-2c72-4f07-92cd-da33ab2266a6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ddb3a3d8-f9d7-46f7-afb7-84ffbc3762bb, pool_id: 1be25b7d-d663-491f-9b22-294625b9b9ed (zpool) }] } file = sled-agent/src/rack_setup/service.rs:375 sled_address = [fd00:1122:3344:101::1]:12345
2612024-09-23T23:08:57.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35676
2622024-09-23T23:08:57.966ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:864 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2632024-09-23T23:08:57.966ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 24cea942-cbad-4c12-b55d-742656c7a16f, pool_id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e9b1cf31-e3a3-43cf-8ddf-2d16b666c1b0, pool_id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: de916f96-454a-4f89-aaf2-ea71291c0174, pool_id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 7a77aac8-c798-4f49-a8ec-44a0ce07cbf7, pool_id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 446ad3ef-d639-41fe-bbeb-2eea73eeb7d7, pool_id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 5e84b15b-5387-4cd7-9e4c-5adcc412b1ee, pool_id: ce967aab-6630-4925-b90b-9c9cb48e90c0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 4aa1bba4-2f35-4907-8754-1cf5fb57b138, pool_id: fd5ca1dd-39f0-4844-af6b-77dcaa746e9d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1bc21899-4684-4321-ae96-d43ab4310347, pool_id: ef338e61-2c72-4f07-92cd-da33ab2266a6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ddb3a3d8-f9d7-46f7-afb7-84ffbc3762bb, pool_id: 1be25b7d-d663-491f-9b22-294625b9b9ed (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:451
2642024-09-23T23:08:57.966ZINFOSledAgent (StorageManager): No ledger in /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2652024-09-23T23:08:57.966ZINFOSledAgent (StorageManager): No ledger in /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2662024-09-23T23:08:57.966ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:866 request = omicron_physical_disks_ensure
2672024-09-23T23:08:57.966ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2682024-09-23T23:08:57.966ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2692024-09-23T23:08:57.966ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2702024-09-23T23:08:57.966ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2712024-09-23T23:08:58.102ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:360
2722024-09-23T23:08:58.102ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool)
2732024-09-23T23:08:58.572ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2742024-09-23T23:08:59.022ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2752024-09-23T23:08:59.022ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2762024-09-23T23:08:59.228ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
2772024-09-23T23:08:59.242ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:185 zpool = ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }
2782024-09-23T23:08:59.249ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:229
2792024-09-23T23:08:59.249ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:231
2802024-09-23T23:08:59.249ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:235
2812024-09-23T23:08:59.249ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:237
2822024-09-23T23:08:59.249ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2832024-09-23T23:08:59.249ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2842024-09-23T23:08:59.249ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:249
2852024-09-23T23:08:59.287ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2862024-09-23T23:08:59.294ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3877506b-1f39-42fc-94ac-b2d382e6869a/crypt/zone file = sled-storage/src/dataset.rs:292
2872024-09-23T23:08:59.505ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3877506b-1f39-42fc-94ac-b2d382e6869a file = sled-storage/src/dataset.rs:378
2882024-09-23T23:08:59.513ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2892024-09-23T23:08:59.513ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2902024-09-23T23:08:59.513ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2912024-09-23T23:08:59.513ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2922024-09-23T23:08:59.513ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2932024-09-23T23:08:59.523ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:360
2942024-09-23T23:08:59.523ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool)
2952024-09-23T23:08:59.643ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:185 zpool = ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }
2962024-09-23T23:08:59.652ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:229
2972024-09-23T23:08:59.652ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:231
2982024-09-23T23:08:59.652ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:235
2992024-09-23T23:08:59.652ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:237
3002024-09-23T23:08:59.652ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3012024-09-23T23:08:59.652ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3022024-09-23T23:08:59.652ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:249
3032024-09-23T23:08:59.656ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
3042024-09-23T23:08:59.696ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3052024-09-23T23:08:59.703ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f28e76df-bcff-4355-b674-7f6f05c9f8dc/crypt/zone file = sled-storage/src/dataset.rs:292
3062024-09-23T23:08:59.930ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f28e76df-bcff-4355-b674-7f6f05c9f8dc file = sled-storage/src/dataset.rs:378
3072024-09-23T23:08:59.938ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3082024-09-23T23:08:59.939ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3092024-09-23T23:08:59.939ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3102024-09-23T23:08:59.939ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3112024-09-23T23:08:59.939ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3122024-09-23T23:08:59.948ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:360
3132024-09-23T23:08:59.948ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool)
3142024-09-23T23:09:00.067ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:185 zpool = ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }
3152024-09-23T23:09:00.075ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:229
3162024-09-23T23:09:00.075ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:231
3172024-09-23T23:09:00.075ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:235
3182024-09-23T23:09:00.075ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:237
3192024-09-23T23:09:00.075ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3202024-09-23T23:09:00.075ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3212024-09-23T23:09:00.075ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:249
3222024-09-23T23:09:00.120ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3232024-09-23T23:09:00.128ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_27622737-fd47-4a66-a552-1d64c0d56a2b/crypt/zone file = sled-storage/src/dataset.rs:292
3242024-09-23T23:09:00.336ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_27622737-fd47-4a66-a552-1d64c0d56a2b file = sled-storage/src/dataset.rs:378
3252024-09-23T23:09:00.344ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3262024-09-23T23:09:00.344ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3272024-09-23T23:09:00.344ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3282024-09-23T23:09:00.344ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3292024-09-23T23:09:00.344ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3302024-09-23T23:09:00.354ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:360
3312024-09-23T23:09:00.354ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool)
3322024-09-23T23:09:00.474ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:185 zpool = ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External }
3332024-09-23T23:09:00.482ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:229
3342024-09-23T23:09:00.482ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:231
3352024-09-23T23:09:00.482ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:235
3362024-09-23T23:09:00.482ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:237
3372024-09-23T23:09:00.482ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3382024-09-23T23:09:00.482ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3392024-09-23T23:09:00.482ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:249
3402024-09-23T23:09:00.528ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3412024-09-23T23:09:00.535ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_82bc7793-c675-49d9-9db9-2f4a2a329bef/crypt/zone file = sled-storage/src/dataset.rs:292
3422024-09-23T23:09:00.659ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
3432024-09-23T23:09:00.762ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_82bc7793-c675-49d9-9db9-2f4a2a329bef file = sled-storage/src/dataset.rs:378
3442024-09-23T23:09:00.770ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3452024-09-23T23:09:00.770ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3462024-09-23T23:09:00.770ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3472024-09-23T23:09:00.770ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3482024-09-23T23:09:00.770ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3492024-09-23T23:09:00.780ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:360
3502024-09-23T23:09:00.780ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool)
3512024-09-23T23:09:00.899ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:185 zpool = ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External }
3522024-09-23T23:09:00.907ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:229
3532024-09-23T23:09:00.907ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:231
3542024-09-23T23:09:00.907ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:235
3552024-09-23T23:09:00.907ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:237
3562024-09-23T23:09:00.907ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3572024-09-23T23:09:00.907ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3582024-09-23T23:09:00.907ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:249
3592024-09-23T23:09:00.949ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3602024-09-23T23:09:00.957ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d78e334d-0261-40af-8332-4a45fd2a8d42/crypt/zone file = sled-storage/src/dataset.rs:292
3612024-09-23T23:09:01.191ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d78e334d-0261-40af-8332-4a45fd2a8d42 file = sled-storage/src/dataset.rs:378
3622024-09-23T23:09:01.199ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3632024-09-23T23:09:01.199ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3642024-09-23T23:09:01.199ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3652024-09-23T23:09:01.199ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3662024-09-23T23:09:01.199ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3672024-09-23T23:09:01.209ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:360
3682024-09-23T23:09:01.209ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = ce967aab-6630-4925-b90b-9c9cb48e90c0 (zpool)
3692024-09-23T23:09:01.335ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:185 zpool = ZpoolName { id: ce967aab-6630-4925-b90b-9c9cb48e90c0 (zpool), kind: External }
3702024-09-23T23:09:01.342ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:229
3712024-09-23T23:09:01.342ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:231
3722024-09-23T23:09:01.342ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:235
3732024-09-23T23:09:01.342ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:237
3742024-09-23T23:09:01.342ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3752024-09-23T23:09:01.343ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3762024-09-23T23:09:01.343ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:249
3772024-09-23T23:09:01.390ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3782024-09-23T23:09:01.398ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ce967aab-6630-4925-b90b-9c9cb48e90c0/crypt/zone file = sled-storage/src/dataset.rs:292
3792024-09-23T23:09:01.634ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ce967aab-6630-4925-b90b-9c9cb48e90c0 file = sled-storage/src/dataset.rs:378
3802024-09-23T23:09:01.642ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3812024-09-23T23:09:01.642ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3822024-09-23T23:09:01.642ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3832024-09-23T23:09:01.642ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3842024-09-23T23:09:01.642ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3852024-09-23T23:09:01.652ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:360
3862024-09-23T23:09:01.652ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = fd5ca1dd-39f0-4844-af6b-77dcaa746e9d (zpool)
3872024-09-23T23:09:01.782ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:185 zpool = ZpoolName { id: fd5ca1dd-39f0-4844-af6b-77dcaa746e9d (zpool), kind: External }
3882024-09-23T23:09:01.790ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:229
3892024-09-23T23:09:01.790ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:231
3902024-09-23T23:09:01.790ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:235
3912024-09-23T23:09:01.790ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:237
3922024-09-23T23:09:01.790ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3932024-09-23T23:09:01.790ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3942024-09-23T23:09:01.790ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:249
3952024-09-23T23:09:01.836ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3962024-09-23T23:09:01.840ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
3972024-09-23T23:09:01.844ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fd5ca1dd-39f0-4844-af6b-77dcaa746e9d/crypt/zone file = sled-storage/src/dataset.rs:292
3982024-09-23T23:09:02.071ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fd5ca1dd-39f0-4844-af6b-77dcaa746e9d file = sled-storage/src/dataset.rs:378
3992024-09-23T23:09:02.079ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4002024-09-23T23:09:02.079ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4012024-09-23T23:09:02.079ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4022024-09-23T23:09:02.079ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4032024-09-23T23:09:02.079ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4042024-09-23T23:09:02.088ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:360
4052024-09-23T23:09:02.088ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = ef338e61-2c72-4f07-92cd-da33ab2266a6 (zpool)
4062024-09-23T23:09:02.207ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:185 zpool = ZpoolName { id: ef338e61-2c72-4f07-92cd-da33ab2266a6 (zpool), kind: External }
4072024-09-23T23:09:02.214ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:229
4082024-09-23T23:09:02.214ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:231
4092024-09-23T23:09:02.214ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:235
4102024-09-23T23:09:02.214ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:237
4112024-09-23T23:09:02.214ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4122024-09-23T23:09:02.215ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4132024-09-23T23:09:02.215ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:249
4142024-09-23T23:09:02.260ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4152024-09-23T23:09:02.267ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ef338e61-2c72-4f07-92cd-da33ab2266a6/crypt/zone file = sled-storage/src/dataset.rs:292
4162024-09-23T23:09:02.494ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ef338e61-2c72-4f07-92cd-da33ab2266a6 file = sled-storage/src/dataset.rs:378
4172024-09-23T23:09:02.509ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4182024-09-23T23:09:02.509ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4192024-09-23T23:09:02.509ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4202024-09-23T23:09:02.509ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4212024-09-23T23:09:02.509ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4222024-09-23T23:09:02.519ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:360
4232024-09-23T23:09:02.519ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 1be25b7d-d663-491f-9b22-294625b9b9ed (zpool)
4242024-09-23T23:09:02.641ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:185 zpool = ZpoolName { id: 1be25b7d-d663-491f-9b22-294625b9b9ed (zpool), kind: External }
4252024-09-23T23:09:02.649ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:229
4262024-09-23T23:09:02.649ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:231
4272024-09-23T23:09:02.649ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:235
4282024-09-23T23:09:02.649ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:237
4292024-09-23T23:09:02.649ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4302024-09-23T23:09:02.649ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4312024-09-23T23:09:02.649ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:249
4322024-09-23T23:09:02.693ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4332024-09-23T23:09:02.701ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1be25b7d-d663-491f-9b22-294625b9b9ed/crypt/zone file = sled-storage/src/dataset.rs:292
4342024-09-23T23:09:02.842ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
4352024-09-23T23:09:02.917ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 16.489295028s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
4362024-09-23T23:09:02.928ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1be25b7d-d663-491f-9b22-294625b9b9ed file = sled-storage/src/dataset.rs:378
4372024-09-23T23:09:02.937ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4382024-09-23T23:09:02.937ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4392024-09-23T23:09:02.937ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4402024-09-23T23:09:02.937ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7073a935-f8ba-4ac8-91ff-452f67ec46db (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 206369d1-a9ea-498a-85ee-23c79d5662f8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ce967aab-6630-4925-b90b-9c9cb48e90c0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: fd5ca1dd-39f0-4844-af6b-77dcaa746e9d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ef338e61-2c72-4f07-92cd-da33ab2266a6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 1be25b7d-d663-491f-9b22-294625b9b9ed (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4412024-09-23T23:09:02.937ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4422024-09-23T23:09:02.937ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4432024-09-23T23:09:02.937ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4442024-09-23T23:09:02.937ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:868 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
4452024-09-23T23:09:02.937ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4462024-09-23T23:09:02.937ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:894 generation = Generation(1) sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
4472024-09-23T23:09:02.937ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:899 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
4482024-09-23T23:09:02.937ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:904 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
4492024-09-23T23:09:02.937ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:121 gen = Generation(1) sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
4502024-09-23T23:09:02.937ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:910 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
4512024-09-23T23:09:02.937ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:773 gen = Generation(1)
4522024-09-23T23:09:02.937ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:915 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
4532024-09-23T23:09:02.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4971504 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35676 req_id = 601fa478-3064-437c-b6c5-1f4340d460e3 response_code = 200 uri = /omicron-physical-disks
4542024-09-23T23:09:02.969ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: c86c6776-f22d-4b00-9f43-3c9b9c343289 (service), underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b2729181-3180-4ecf-bd42-a48f1144b71d (service), underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 65799211-2178-4ef6-a14b-629ea048347e (service), underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:458 sled_address = [fd00:1122:3344:101::1]:12345
4552024-09-23T23:09:02.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59328
4562024-09-23T23:09:02.969ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c86c6776-f22d-4b00-9f43-3c9b9c343289, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4572024-09-23T23:09:02.969ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: c86c6776-f22d-4b00-9f43-3c9b9c343289, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: InternalDns }, responder: ... }
4582024-09-23T23:09:03.031ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b2729181-3180-4ecf-bd42-a48f1144b71d, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4592024-09-23T23:09:03.031ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: b2729181-3180-4ecf-bd42-a48f1144b71d, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: InternalDns }, responder: ... }
4602024-09-23T23:09:03.094ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 65799211-2178-4ef6-a14b-629ea048347e, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4612024-09-23T23:09:03.094ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 65799211-2178-4ef6-a14b-629ea048347e, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: InternalDns }, responder: ... }
4622024-09-23T23:09:03.158ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4632024-09-23T23:09:03.158ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/omicron-zones.json file = common/src/ledger.rs:188
4642024-09-23T23:09:03.158ZINFOSledAgent (ServiceManager): No ledger in /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/omicron-zones.json file = common/src/ledger.rs:188
4652024-09-23T23:09:03.158ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4662024-09-23T23:09:03.204ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4672024-09-23T23:09:03.204ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4682024-09-23T23:09:03.204ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4692024-09-23T23:09:03.255ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d file = illumos-utils/src/zone.rs:316
4702024-09-23T23:09:03.259ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e file = illumos-utils/src/zone.rs:316
4712024-09-23T23:09:03.262ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289 file = illumos-utils/src/zone.rs:316
4722024-09-23T23:09:03.275ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d file = illumos-utils/src/zone.rs:354
4732024-09-23T23:09:03.280ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e file = illumos-utils/src/zone.rs:354
4742024-09-23T23:09:03.284ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289 file = illumos-utils/src/zone.rs:354
4752024-09-23T23:09:03.844ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
4762024-09-23T23:09:04.804ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4772024-09-23T23:09:04.804ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4782024-09-23T23:09:04.804ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
4792024-09-23T23:09:05.287ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4802024-09-23T23:09:05.765ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4812024-09-23T23:09:05.765ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4822024-09-23T23:09:05.765ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4832024-09-23T23:09:05.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d") failed: Property not found. retry in 58.442824ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
4842024-09-23T23:09:05.774ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e
4852024-09-23T23:09:05.778ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289
4862024-09-23T23:09:05.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d") failed: Property not found. retry in 90.740924ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
4872024-09-23T23:09:05.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e") failed: Property not found. retry in 50.155316ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e
4882024-09-23T23:09:05.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289") failed: Property not found. retry in 36.602847ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289
4892024-09-23T23:09:05.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d") failed: Property not found. retry in 233.567158ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
4902024-09-23T23:09:05.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289") failed: Property not found. retry in 97.382463ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289
4912024-09-23T23:09:05.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e") failed: Property not found. retry in 115.64643ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e
4922024-09-23T23:09:06.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289") failed: Property not found. retry in 145.238675ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289
4932024-09-23T23:09:06.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d") failed: Property not found. retry in 368.973956ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
4942024-09-23T23:09:06.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e") failed: Property not found. retry in 139.086167ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e
4952024-09-23T23:09:06.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289") failed: Property not found. retry in 259.186753ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289
4962024-09-23T23:09:06.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e") failed: Property not found. retry in 221.111464ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e
4972024-09-23T23:09:06.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d") failed: Property not found. retry in 890.717467ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
4982024-09-23T23:09:06.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e") failed: Property not found. retry in 845.139807ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e
4992024-09-23T23:09:06.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289") failed: Property not found. retry in 661.932371ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289
5002024-09-23T23:09:07.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289") failed: Property not found. retry in 1.284767017s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289
5012024-09-23T23:09:07.425ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8769784392672881974 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
5022024-09-23T23:09:07.425ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8437288872673826417 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
5032024-09-23T23:09:07.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e") failed: Property not found. retry in 1.184115938s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e
5042024-09-23T23:09:07.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d") failed: Property not found. retry in 867.533279ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
5052024-09-23T23:09:07.691ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4262
5062024-09-23T23:09:07.691ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4272 gateway = fd00:1122:3344:101::1
5072024-09-23T23:09:07.698ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4351
5082024-09-23T23:09:07.836ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4399
5092024-09-23T23:09:07.836ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4426
5102024-09-23T23:09:07.881ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4439
5112024-09-23T23:09:07.881ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4303
5122024-09-23T23:09:07.942ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4345
5132024-09-23T23:09:07.942ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4406 rack_subnet = fd00:1122:3344::
5142024-09-23T23:09:07.965ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4417
5152024-09-23T23:09:07.965ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4459
5162024-09-23T23:09:08.072ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4491
5172024-09-23T23:09:08.072ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4497
5182024-09-23T23:09:08.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:35235
5192024-09-23T23:09:08.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:35235 req_id = ecfd3f9a-ea58-44fb-b3fa-5801bc9ddbe6 response_code = 200 uri = /sled-identifiers
5202024-09-23T23:09:08.200ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4538
5212024-09-23T23:09:08.200ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:366
5222024-09-23T23:09:08.233ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:571 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
5232024-09-23T23:09:08.234ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:414
5242024-09-23T23:09:08.266ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:676
5252024-09-23T23:09:08.266ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:714
5262024-09-23T23:09:08.266ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:717 uptime = 0
5272024-09-23T23:09:08.267ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:436
5282024-09-23T23:09:08.302ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
5292024-09-23T23:09:08.354ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
5302024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5312024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5322024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5332024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5342024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5352024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5362024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5372024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5382024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5392024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5402024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5412024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5422024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5432024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5442024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5452024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5462024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5472024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5482024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5492024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5502024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5512024-09-23T23:09:08.354ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5522024-09-23T23:09:08.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d") failed: Property not found. retry in 565.56883ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
5532024-09-23T23:09:08.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289") failed: Property not found. retry in 942.103615ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289
5542024-09-23T23:09:08.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e") failed: Property not found. retry in 774.912695ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e
5552024-09-23T23:09:08.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d") failed: Property not found. retry in 643.861314ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
5562024-09-23T23:09:09.024ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
5572024-09-23T23:09:09.024ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
5582024-09-23T23:09:09.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e") failed: Property not found. retry in 1.306745863s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e
5592024-09-23T23:09:09.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289") failed: Property not found. retry in 1.256351033s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289
5602024-09-23T23:09:09.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d") failed: Property not found. retry in 508.074527ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
5612024-09-23T23:09:10.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d") failed: Property not found. retry in 912.363566ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
5622024-09-23T23:09:10.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e") failed: Property not found. retry in 752.677786ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e
5632024-09-23T23:09:10.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289") failed: Property not found. retry in 901.617168ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289
5642024-09-23T23:09:11.753ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_internal_dns_b2729181-3180-4ecf-bd42-a48f1144b71d
5652024-09-23T23:09:11.753ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_internal_dns_65799211-2178-4ef6-a14b-629ea048347e
5662024-09-23T23:09:11.753ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_internal_dns_c86c6776-f22d-4b00-9f43-3c9b9c343289
5672024-09-23T23:09:11.753ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5682024-09-23T23:09:11.754ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5692024-09-23T23:09:11.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8785227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59328 req_id = 14ead1f3-0f80-4c28-b621-ec9f61434f8b response_code = 204 uri = /omicron-zones
5702024-09-23T23:09:11.757ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:575
5712024-09-23T23:09:11.812ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:575
5722024-09-23T23:09:11.873ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:575
5732024-09-23T23:09:11.929ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:611
5742024-09-23T23:09:11.929ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5752024-09-23T23:09:11.960ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5762024-09-23T23:09:11.960ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5772024-09-23T23:09:11.961ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5782024-09-23T23:09:11.989ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: c86c6776-f22d-4b00-9f43-3c9b9c343289 (service), underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b2729181-3180-4ecf-bd42-a48f1144b71d (service), underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 65799211-2178-4ef6-a14b-629ea048347e (service), underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b50fe4ad-b778-4fab-a3a7-685a6f574318 (service), underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: dba4edd6-2508-46ba-8f31-1f85c385ae5b, kind: Service { id: b50fe4ad-b778-4fab-a3a7-685a6f574318 }, name: Name("ntp-b50fe4ad-b778-4fab-a3a7-685a6f574318"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 49])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:458 sled_address = [fd00:1122:3344:101::1]:12345
5792024-09-23T23:09:11.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62034
5802024-09-23T23:09:11.989ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c86c6776-f22d-4b00-9f43-3c9b9c343289, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5812024-09-23T23:09:11.989ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: c86c6776-f22d-4b00-9f43-3c9b9c343289, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: InternalDns }, responder: ... }
5822024-09-23T23:09:12.009ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b2729181-3180-4ecf-bd42-a48f1144b71d, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5832024-09-23T23:09:12.009ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: b2729181-3180-4ecf-bd42-a48f1144b71d, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: InternalDns }, responder: ... }
5842024-09-23T23:09:12.025ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 65799211-2178-4ef6-a14b-629ea048347e, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5852024-09-23T23:09:12.025ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 65799211-2178-4ef6-a14b-629ea048347e, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: InternalDns }, responder: ... }
5862024-09-23T23:09:12.041ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5872024-09-23T23:09:12.041ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/omicron-zones.json file = common/src/ledger.rs:177
5882024-09-23T23:09:12.041ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/omicron-zones.json file = common/src/ledger.rs:177
5892024-09-23T23:09:12.041ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5902024-09-23T23:09:12.051ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5912024-09-23T23:09:12.084ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5922024-09-23T23:09:12.086ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5932024-09-23T23:09:12.086ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5942024-09-23T23:09:12.116ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 218, 49]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5952024-09-23T23:09:12.116ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1261 zone_type = boundary_ntp
5962024-09-23T23:09:12.116ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
5972024-09-23T23:09:12.116ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
5982024-09-23T23:09:12.116ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
5992024-09-23T23:09:12.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6002024-09-23T23:09:12.140ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318 file = illumos-utils/src/zone.rs:316
6012024-09-23T23:09:12.158ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318 file = illumos-utils/src/zone.rs:354
6022024-09-23T23:09:12.788ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6032024-09-23T23:09:12.788ZINFOSledAgent (ServiceManager): Booting oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318
6042024-09-23T23:09:12.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318") failed: Property not found. retry in 39.874605ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318
6052024-09-23T23:09:12.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318") failed: Property not found. retry in 113.999115ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318
6062024-09-23T23:09:13.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318") failed: Property not found. retry in 211.372367ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318
6072024-09-23T23:09:13.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318") failed: Property not found. retry in 483.262956ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318
6082024-09-23T23:09:13.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318") failed: Property not found. retry in 913.719019ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318
6092024-09-23T23:09:14.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318") failed: Property not found. retry in 596.909206ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318
6102024-09-23T23:09:15.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318") failed: Property not found. retry in 1.355040606s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318
6112024-09-23T23:09:16.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318") failed: Property not found. retry in 843.627545ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318
6122024-09-23T23:09:17.427ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8769784392672881974 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6132024-09-23T23:09:17.428ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8437288872673826417 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6142024-09-23T23:09:17.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318") failed: Property not found. retry in 683.759706ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318
6152024-09-23T23:09:18.313ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318
6162024-09-23T23:09:18.313ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6172024-09-23T23:09:18.313ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6182024-09-23T23:09:18.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6324499 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62034 req_id = 544b7ef2-5bc2-45b3-8053-9b1e91d2541e response_code = 204 uri = /omicron-zones
6192024-09-23T23:09:18.316ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:652
6202024-09-23T23:09:18.346ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6212024-09-23T23:09:18.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40406
6222024-09-23T23:09:18.355ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3870
6232024-09-23T23:09:18.355ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 8509 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40406 req_id = 3460a25a-91f5-4d59-a224-f7050ee88fc1 response_code = 500 uri = /timesync
6242024-09-23T23:09:18.357ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6252024-09-23T23:09:18.481ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6262024-09-23T23:09:18.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45323
6272024-09-23T23:09:19.027ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6282024-09-23T23:09:19.027ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6292024-09-23T23:09:21.072ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15965241186540069973 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6302024-09-23T23:09:21.551ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17146931977441740195 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6312024-09-23T23:09:21.756ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9407049868805033054 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6322024-09-23T23:09:22.490ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3870
6332024-09-23T23:09:22.490ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 4009213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45323 req_id = 9361dac1-de8e-4d88-8b74-97fb208d5a0b response_code = 500 uri = /timesync
6342024-09-23T23:09:22.492ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6352024-09-23T23:09:22.649ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6362024-09-23T23:09:22.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54892
6372024-09-23T23:09:22.658ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3870
6382024-09-23T23:09:22.659ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 9042 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54892 req_id = 159e3c2e-26a9-4244-bc3b-2c492173e62f response_code = 500 uri = /timesync
6392024-09-23T23:09:22.661ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6402024-09-23T23:09:22.815ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6412024-09-23T23:09:22.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40907
6422024-09-23T23:09:26.199ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b50fe4ad-b778-4fab-a3a7-685a6f574318': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3870
6432024-09-23T23:09:26.199ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 4009162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40907 req_id = b60fc9a6-9cb4-4d5e-b876-7528f88d2885 response_code = 500 uri = /timesync
6442024-09-23T23:09:26.202ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6452024-09-23T23:09:26.483ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6462024-09-23T23:09:26.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41112
6472024-09-23T23:09:26.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9551 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41112 req_id = 440260c8-1d83-458d-8569-f47e3516cf81 response_code = 200 uri = /timesync
6482024-09-23T23:09:26.496ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.2734029 } file = sled-agent/src/rack_setup/service.rs:660
6492024-09-23T23:09:26.496ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6502024-09-23T23:09:26.673ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6512024-09-23T23:09:26.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59255
6522024-09-23T23:09:26.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7507 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59255 req_id = 82ee0b7d-eca2-40b0-b2d3-a5867f8b8607 response_code = 200 uri = /timesync
6532024-09-23T23:09:26.684ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.272890121 } file = sled-agent/src/rack_setup/service.rs:660
6542024-09-23T23:09:26.684ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6552024-09-23T23:09:26.804ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8769784392672881974 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6562024-09-23T23:09:26.804ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8437288872673826417 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6572024-09-23T23:09:27.037ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6582024-09-23T23:09:27.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48789
6592024-09-23T23:09:27.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7947 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48789 req_id = 42fc4c90-792a-4434-800b-0f14ab256b73 response_code = 200 uri = /timesync
6602024-09-23T23:09:27.047ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.272896379 } file = sled-agent/src/rack_setup/service.rs:660
6612024-09-23T23:09:27.047ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6622024-09-23T23:09:27.288ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6632024-09-23T23:09:27.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65390
6642024-09-23T23:09:27.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7009 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65390 req_id = 83a64fd4-fefd-4792-be26-87dd796d8a5b response_code = 200 uri = /timesync
6652024-09-23T23:09:27.298ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.272215962 } file = sled-agent/src/rack_setup/service.rs:660
6662024-09-23T23:09:27.298ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6672024-09-23T23:09:27.622ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6682024-09-23T23:09:27.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53481
6692024-09-23T23:09:27.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6535 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53481 req_id = d603d410-94fa-4b29-9fc8-c4ab407092f2 response_code = 200 uri = /timesync
6702024-09-23T23:09:27.631ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.271309853 } file = sled-agent/src/rack_setup/service.rs:660
6712024-09-23T23:09:27.631ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6722024-09-23T23:09:27.688ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5330562628629505977 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6732024-09-23T23:09:27.688ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17256640605804727500 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6742024-09-23T23:09:28.073ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6752024-09-23T23:09:28.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54358
6762024-09-23T23:09:28.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9746 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54358 req_id = ead4c872-8cb8-40fe-ae4d-bb6ec45b0bf1 response_code = 200 uri = /timesync
6772024-09-23T23:09:28.087ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.269667685 } file = sled-agent/src/rack_setup/service.rs:660
6782024-09-23T23:09:28.087ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6792024-09-23T23:09:28.398ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6802024-09-23T23:09:28.398ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6812024-09-23T23:09:28.511ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6822024-09-23T23:09:28.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53189
6832024-09-23T23:09:28.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9480 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53189 req_id = 6380948e-62f5-41c8-8c16-9474db1d245f response_code = 200 uri = /timesync
6842024-09-23T23:09:28.526ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.268479884 } file = sled-agent/src/rack_setup/service.rs:660
6852024-09-23T23:09:28.526ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6862024-09-23T23:09:29.245ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6872024-09-23T23:09:29.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49666
6882024-09-23T23:09:29.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8657 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49666 req_id = d3898b2a-b237-4c31-9f6b-0e6df0c994c6 response_code = 200 uri = /timesync
6892024-09-23T23:09:29.258ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.266310424 } file = sled-agent/src/rack_setup/service.rs:660
6902024-09-23T23:09:29.258ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6912024-09-23T23:09:29.958ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6922024-09-23T23:09:29.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52692
6932024-09-23T23:09:29.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8629 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52692 req_id = 0852cf03-edb3-463f-9964-774beccfff91 response_code = 200 uri = /timesync
6942024-09-23T23:09:29.970ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.264275104 } file = sled-agent/src/rack_setup/service.rs:660
6952024-09-23T23:09:29.970ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6962024-09-23T23:09:30.449ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6972024-09-23T23:09:30.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49300
6982024-09-23T23:09:30.455ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15965241186540069973 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
6992024-09-23T23:09:30.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9037 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49300 req_id = be7eaef7-7bf5-4e85-ad10-fe621addb11b response_code = 200 uri = /timesync
7002024-09-23T23:09:30.461ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.262940109 } file = sled-agent/src/rack_setup/service.rs:660
7012024-09-23T23:09:30.461ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7022024-09-23T23:09:30.915ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17146931977441740195 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7032024-09-23T23:09:31.119ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9407049868805033054 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7042024-09-23T23:09:32.053ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7052024-09-23T23:09:32.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63292
7062024-09-23T23:09:32.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8716 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63292 req_id = 483aad8b-6cef-4947-94c9-0a9cb8246225 response_code = 200 uri = /timesync
7072024-09-23T23:09:32.066ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727132970.6081252, correction: -0.258381605 } file = sled-agent/src/rack_setup/service.rs:660
7082024-09-23T23:09:32.066ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7092024-09-23T23:09:33.799ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 217.216597ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7102024-09-23T23:09:33.961ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7112024-09-23T23:09:33.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40029
7122024-09-23T23:09:33.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40029 req_id = f77f2af1-c79b-4e7e-86ea-2a1884afb731 response_code = 200 uri = /timesync
7132024-09-23T23:09:33.971ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727132971.6078155, correction: -0.253195524 } file = sled-agent/src/rack_setup/service.rs:660
7142024-09-23T23:09:33.971ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7152024-09-23T23:09:35.756ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7162024-09-23T23:09:35.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61799
7172024-09-23T23:09:35.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9094 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61799 req_id = e631203c-dff7-49e7-bd69-fad78ee649fd response_code = 200 uri = /timesync
7182024-09-23T23:09:35.767ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727132973.9643018, correction: -0.248579055 } file = sled-agent/src/rack_setup/service.rs:660
7192024-09-23T23:09:35.767ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7202024-09-23T23:09:36.779ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8769784392672881974 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7212024-09-23T23:09:36.779ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8437288872673826417 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7222024-09-23T23:09:37.249ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36434
7232024-09-23T23:09:37.249ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36434 req_id = 65cdc803-f8fb-49e6-ba6f-784fdfe5da3c response_code = 200 uri = /baseboard
7242024-09-23T23:09:37.303ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7252024-09-23T23:09:37.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51432
7262024-09-23T23:09:37.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51432 req_id = 63d8e287-57ca-418e-80d7-cee26dd9b10a response_code = 200 uri = /timesync
7272024-09-23T23:09:37.313ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727132975.9885085, correction: -0.244896963 } file = sled-agent/src/rack_setup/service.rs:660
7282024-09-23T23:09:37.313ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7292024-09-23T23:09:37.664ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5330562628629505977 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7302024-09-23T23:09:37.664ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17256640605804727500 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7312024-09-23T23:09:38.373ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7322024-09-23T23:09:38.373ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7332024-09-23T23:09:38.459ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7342024-09-23T23:09:38.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62369
7352024-09-23T23:09:38.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7829 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62369 req_id = 775c9f50-115e-476e-be7c-d205aa6cf735 response_code = 200 uri = /timesync
7362024-09-23T23:09:38.470ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727132977.5430136, correction: -0.241508543 } file = sled-agent/src/rack_setup/service.rs:660
7372024-09-23T23:09:38.470ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7382024-09-23T23:09:40.430ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15965241186540069973 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7392024-09-23T23:09:40.889ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17146931977441740195 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7402024-09-23T23:09:41.093ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9407049868805033054 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7412024-09-23T23:09:42.197ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7422024-09-23T23:09:42.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49112
7432024-09-23T23:09:42.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8529 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49112 req_id = b39c70f9-8ead-4f72-b2e5-1e1b74c7c21e response_code = 200 uri = /timesync
7442024-09-23T23:09:42.209ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727132980.0884418, correction: -0.231641352 } file = sled-agent/src/rack_setup/service.rs:660
7452024-09-23T23:09:42.209ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7462024-09-23T23:09:46.611ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7472024-09-23T23:09:46.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34272
7482024-09-23T23:09:46.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34272 req_id = 4873ec4c-e847-4338-af80-5d4022337036 response_code = 200 uri = /timesync
7492024-09-23T23:09:46.625ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727132985.4561749, correction: -0.219250172 } file = sled-agent/src/rack_setup/service.rs:660
7502024-09-23T23:09:46.625ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7512024-09-23T23:09:46.754ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8769784392672881974 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7522024-09-23T23:09:46.754ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8437288872673826417 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7532024-09-23T23:09:47.638ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5330562628629505977 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7542024-09-23T23:09:47.638ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17256640605804727500 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7552024-09-23T23:09:48.347ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7562024-09-23T23:09:48.348ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7572024-09-23T23:09:49.012ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 314.829729ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7582024-09-23T23:09:50.208ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7592024-09-23T23:09:50.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39736
7602024-09-23T23:09:50.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9602 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39736 req_id = 90948610-e7f1-46cf-a4e4-2dd06bb6e112 response_code = 200 uri = /timesync
7612024-09-23T23:09:50.222ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727132988.4974284, correction: -0.209398106 } file = sled-agent/src/rack_setup/service.rs:660
7622024-09-23T23:09:50.222ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7632024-09-23T23:09:50.404ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15965241186540069973 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7642024-09-23T23:09:50.863ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17146931977441740195 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7652024-09-23T23:09:51.067ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9407049868805033054 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7662024-09-23T23:09:56.578ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7672024-09-23T23:09:56.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33640
7682024-09-23T23:09:56.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8486 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33640 req_id = e92485ed-64ee-4772-b241-e61a0f66d8d5 response_code = 200 uri = /timesync
7692024-09-23T23:09:56.591ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727132993.8669558, correction: -0.191895932 } file = sled-agent/src/rack_setup/service.rs:660
7702024-09-23T23:09:56.591ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7712024-09-23T23:09:56.728ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8769784392672881974 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7722024-09-23T23:09:56.729ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8437288872673826417 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7732024-09-23T23:09:57.613ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5330562628629505977 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7742024-09-23T23:09:57.613ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17256640605804727500 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7752024-09-23T23:09:58.323ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7762024-09-23T23:09:58.323ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7772024-09-23T23:10:00.379ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15965241186540069973 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7782024-09-23T23:10:00.837ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17146931977441740195 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7792024-09-23T23:10:01.042ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9407049868805033054 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7802024-09-23T23:10:01.664ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7812024-09-23T23:10:01.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61893
7822024-09-23T23:10:01.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9373 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61893 req_id = 2578d9b1-9891-421a-889f-d01b1ce0aa61 response_code = 200 uri = /timesync
7832024-09-23T23:10:01.678ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727133000.2618628, correction: -0.178040728 } file = sled-agent/src/rack_setup/service.rs:660
7842024-09-23T23:10:01.678ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7852024-09-23T23:10:04.319ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.176956054s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7862024-09-23T23:10:06.703ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8769784392672881974 reason = Duration(60s) sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7872024-09-23T23:10:06.703ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8437288872673826417 reason = Duration(60s) sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7882024-09-23T23:10:07.202ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33375
7892024-09-23T23:10:07.202ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33375 req_id = bf6dac96-16f1-4282-8316-c8236cb94a50 response_code = 200 uri = /baseboard
7902024-09-23T23:10:07.588ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5330562628629505977 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7912024-09-23T23:10:07.588ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17256640605804727500 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7922024-09-23T23:10:08.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7932024-09-23T23:10:08.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
7942024-09-23T23:10:09.810ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7952024-09-23T23:10:09.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56679
7962024-09-23T23:10:09.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8934 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56679 req_id = 53f0de18-5d97-4750-ab2f-afdee2eb692e response_code = 200 uri = /timesync
7972024-09-23T23:10:09.824ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727133008.9055448, correction: -0.15597631 } file = sled-agent/src/rack_setup/service.rs:660
7982024-09-23T23:10:09.824ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7992024-09-23T23:10:10.354ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15965241186540069973 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8002024-09-23T23:10:10.811ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17146931977441740195 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8012024-09-23T23:10:11.016ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9407049868805033054 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8022024-09-23T23:10:17.563ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5330562628629505977 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8032024-09-23T23:10:17.563ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17256640605804727500 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8042024-09-23T23:10:18.273ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8052024-09-23T23:10:18.273ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8062024-09-23T23:10:19.587ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
8072024-09-23T23:10:19.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63848
8082024-09-23T23:10:19.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9745 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63848 req_id = 7f06fc87-4530-4b67-a4ef-657e929257d4 response_code = 200 uri = /timesync
8092024-09-23T23:10:19.600ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727133017.03483, correction: -0.129408881 } file = sled-agent/src/rack_setup/service.rs:660
8102024-09-23T23:10:19.600ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
8112024-09-23T23:10:20.330ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15965241186540069973 reason = Duration(60s) sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8122024-09-23T23:10:20.486ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.846206754s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8132024-09-23T23:10:20.785ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17146931977441740195 reason = Duration(60s) sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8142024-09-23T23:10:20.990ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9407049868805033054 reason = Duration(60s) sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8152024-09-23T23:10:27.538ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5330562628629505977 reason = Duration(60s) sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8162024-09-23T23:10:27.539ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17256640605804727500 reason = Duration(60s) sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8172024-09-23T23:10:28.248ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8182024-09-23T23:10:28.248ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8192024-09-23T23:10:28.354ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
8202024-09-23T23:10:28.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48839
8212024-09-23T23:10:28.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8981 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48839 req_id = 36ab8f55-00e0-4a6b-a5bc-e8a2985b6323 response_code = 200 uri = /timesync
8222024-09-23T23:10:28.366ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727133024.9225922, correction: -0.105610266 } file = sled-agent/src/rack_setup/service.rs:660
8232024-09-23T23:10:28.366ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
8242024-09-23T23:10:37.156ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50348
8252024-09-23T23:10:37.156ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50348 req_id = e3f3191f-7721-4b8a-8803-13c768d3e240 response_code = 200 uri = /baseboard
8262024-09-23T23:10:37.321ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.585276396s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8272024-09-23T23:10:38.223ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8282024-09-23T23:10:38.223ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8292024-09-23T23:10:39.540ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
8302024-09-23T23:10:39.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50060
8312024-09-23T23:10:39.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8867 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50060 req_id = 3233e653-31f5-4348-a302-60725c9dd015 response_code = 200 uri = /timesync
8322024-09-23T23:10:39.553ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727133032.2827957, correction: -0.07525859 } file = sled-agent/src/rack_setup/service.rs:660
8332024-09-23T23:10:39.553ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
8342024-09-23T23:10:47.105ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
8352024-09-23T23:10:47.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46903
8362024-09-23T23:10:47.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8969 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46903 req_id = 7462da2c-6938-4df1-a0f2-80e083d8863f response_code = 200 uri = /timesync
8372024-09-23T23:10:47.117ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727133041.0786023, correction: -0.054812692 } file = sled-agent/src/rack_setup/service.rs:660
8382024-09-23T23:10:47.117ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
8392024-09-23T23:10:48.198ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8402024-09-23T23:10:48.198ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8412024-09-23T23:10:57.887ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.535416692s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8422024-09-23T23:10:58.173ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3449041278779267801 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8432024-09-23T23:10:58.173ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12058059254565128693 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8442024-09-23T23:11:00.489ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
8452024-09-23T23:11:00.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65307
8462024-09-23T23:11:00.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 23590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65307 req_id = ab2dc807-c76f-4d2e-91d9-14bc1044face response_code = 200 uri = /timesync
8472024-09-23T23:11:00.515ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-09-23T23:10:06.703277733Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8769784392672881974 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8482024-09-23T23:11:00.515ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-09-23T23:10:06.703797349Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8437288872673826417 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8492024-09-23T23:11:00.515ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-09-23T23:10:20.330084196Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15965241186540069973 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8502024-09-23T23:11:00.515ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-09-23T23:10:20.990689190Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9407049868805033054 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8512024-09-23T23:11:00.516ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-09-23T23:10:27.539016064Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17256640605804727500 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8522024-09-23T23:11:00.516ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-09-23T23:10:27.538755761Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5330562628629505977 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8532024-09-23T23:11:00.516ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-09-23T23:10:20.785897064Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17146931977441740195 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8542024-09-23T23:11:00.519ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1727133057.358366, correction: -0.018464429 } file = sled-agent/src/rack_setup/service.rs:660
8552024-09-23T23:11:00.519ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1299
8562024-09-23T23:11:00.549ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: c86c6776-f22d-4b00-9f43-3c9b9c343289 (service), underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b2729181-3180-4ecf-bd42-a48f1144b71d (service), underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 65799211-2178-4ef6-a14b-629ea048347e (service), underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b50fe4ad-b778-4fab-a3a7-685a6f574318 (service), underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: dba4edd6-2508-46ba-8f31-1f85c385ae5b, kind: Service { id: b50fe4ad-b778-4fab-a3a7-685a6f574318 }, name: Name("ntp-b50fe4ad-b778-4fab-a3a7-685a6f574318"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 49])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: edfcb679-1fe3-472b-a9da-78c2f419290c (service), underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External } } } }, OmicronZoneConfig { id: 5de84641-2340-4c69-af19-09fcc80de08e (service), underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External } } } }, OmicronZoneConfig { id: 819223d8-f233-41fc-b28b-2f89d285e4c1 (service), underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External } } } }, OmicronZoneConfig { id: aa048210-e58e-499f-9625-fe41caf5296f (service), underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External } } } }, OmicronZoneConfig { id: 61cdf299-97b9-49df-8210-9eebf86d6522 (service), underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:458 sled_address = [fd00:1122:3344:101::1]:12345
8572024-09-23T23:11:00.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61525
8582024-09-23T23:11:00.549ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c86c6776-f22d-4b00-9f43-3c9b9c343289, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8592024-09-23T23:11:00.549ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: c86c6776-f22d-4b00-9f43-3c9b9c343289, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: InternalDns }, responder: ... }
8602024-09-23T23:11:00.570ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b2729181-3180-4ecf-bd42-a48f1144b71d, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8612024-09-23T23:11:00.570ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: b2729181-3180-4ecf-bd42-a48f1144b71d, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: InternalDns }, responder: ... }
8622024-09-23T23:11:00.588ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 65799211-2178-4ef6-a14b-629ea048347e, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8632024-09-23T23:11:00.588ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 65799211-2178-4ef6-a14b-629ea048347e, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: InternalDns }, responder: ... }
8642024-09-23T23:11:00.606ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edfcb679-1fe3-472b-a9da-78c2f419290c, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8652024-09-23T23:11:00.606ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: edfcb679-1fe3-472b-a9da-78c2f419290c, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: Cockroach }, responder: ... }
8662024-09-23T23:11:00.670ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5de84641-2340-4c69-af19-09fcc80de08e, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8672024-09-23T23:11:00.670ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 5de84641-2340-4c69-af19-09fcc80de08e, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: Cockroach }, responder: ... }
8682024-09-23T23:11:00.733ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 819223d8-f233-41fc-b28b-2f89d285e4c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8692024-09-23T23:11:00.733ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 819223d8-f233-41fc-b28b-2f89d285e4c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: Cockroach }, responder: ... }
8702024-09-23T23:11:00.793ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aa048210-e58e-499f-9625-fe41caf5296f, dataset_name: DatasetName { pool_name: ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8712024-09-23T23:11:00.793ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: aa048210-e58e-499f-9625-fe41caf5296f, dataset_name: DatasetName { pool_name: ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External }, kind: Cockroach }, responder: ... }
8722024-09-23T23:11:00.853ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 61cdf299-97b9-49df-8210-9eebf86d6522, dataset_name: DatasetName { pool_name: ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8732024-09-23T23:11:00.854ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 61cdf299-97b9-49df-8210-9eebf86d6522, dataset_name: DatasetName { pool_name: ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8742024-09-23T23:11:00.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8752024-09-23T23:11:00.914ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/omicron-zones.json file = common/src/ledger.rs:177
8762024-09-23T23:11:00.914ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/omicron-zones.json file = common/src/ledger.rs:177
8772024-09-23T23:11:00.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8782024-09-23T23:11:00.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8792024-09-23T23:11:00.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8802024-09-23T23:11:00.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8812024-09-23T23:11:00.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8822024-09-23T23:11:00.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8832024-09-23T23:11:01.086ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f file = illumos-utils/src/zone.rs:316
8842024-09-23T23:11:01.090ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c file = illumos-utils/src/zone.rs:316
8852024-09-23T23:11:01.094ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e file = illumos-utils/src/zone.rs:316
8862024-09-23T23:11:01.098ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1 file = illumos-utils/src/zone.rs:316
8872024-09-23T23:11:01.102ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522 file = illumos-utils/src/zone.rs:316
8882024-09-23T23:11:01.107ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f file = illumos-utils/src/zone.rs:354
8892024-09-23T23:11:01.112ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c file = illumos-utils/src/zone.rs:354
8902024-09-23T23:11:01.116ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e file = illumos-utils/src/zone.rs:354
8912024-09-23T23:11:01.121ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1 file = illumos-utils/src/zone.rs:354
8922024-09-23T23:11:01.125ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522 file = illumos-utils/src/zone.rs:354
8932024-09-23T23:11:04.007ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='aa048210-e58e-499f-9625-fe41caf5296f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8942024-09-23T23:11:04.007ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
8952024-09-23T23:11:04.017ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5de84641-2340-4c69-af19-09fcc80de08e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8962024-09-23T23:11:04.017ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
8972024-09-23T23:11:04.083ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='819223d8-f233-41fc-b28b-2f89d285e4c1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8982024-09-23T23:11:04.084ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
8992024-09-23T23:11:04.094ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='61cdf299-97b9-49df-8210-9eebf86d6522'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9002024-09-23T23:11:04.094ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9012024-09-23T23:11:04.129ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='edfcb679-1fe3-472b-a9da-78c2f419290c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9022024-09-23T23:11:04.129ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9032024-09-23T23:11:04.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 59.210653ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9042024-09-23T23:11:04.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e") failed: Property not found. retry in 57.055146ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9052024-09-23T23:11:04.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1") failed: Property not found. retry in 40.972349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
9062024-09-23T23:11:04.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 87.435854ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9072024-09-23T23:11:04.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e") failed: Property not found. retry in 79.697126ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9082024-09-23T23:11:04.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1") failed: Property not found. retry in 59.289093ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
9092024-09-23T23:11:04.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 32.202663ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9102024-09-23T23:11:04.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 207.815035ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9112024-09-23T23:11:04.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 63.476509ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9122024-09-23T23:11:04.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e") failed: Property not found. retry in 168.157759ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9132024-09-23T23:11:05.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1") failed: Property not found. retry in 100.856173ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
9142024-09-23T23:11:05.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 120.599466ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9152024-09-23T23:11:05.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 263.90077ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9162024-09-23T23:11:05.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 99.181344ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9172024-09-23T23:11:06.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e") failed: Property not found. retry in 594.668474ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9182024-09-23T23:11:06.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1") failed: Property not found. retry in 334.128507ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
9192024-09-23T23:11:06.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 146.818944ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9202024-09-23T23:11:06.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 750.905831ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9212024-09-23T23:11:06.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 292.37214ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9222024-09-23T23:11:06.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 487.094162ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9232024-09-23T23:11:06.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1") failed: Property not found. retry in 1.002379923s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
9242024-09-23T23:11:07.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e") failed: Property not found. retry in 631.446911ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9252024-09-23T23:11:07.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 514.747584ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9262024-09-23T23:11:07.108ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49012
9272024-09-23T23:11:07.108ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49012 req_id = 7544bb10-8918-47f0-ae0d-5b10ea23e27c response_code = 200 uri = /baseboard
9282024-09-23T23:11:07.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 641.646063ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9292024-09-23T23:11:07.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 1.309400153s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9302024-09-23T23:11:07.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 1.066105689s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9312024-09-23T23:11:07.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e") failed: Property not found. retry in 695.627561ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9322024-09-23T23:11:07.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1") failed: Property not found. retry in 1.341766001s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
9332024-09-23T23:11:08.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 763.14304ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9342024-09-23T23:11:08.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e") failed: Property not found. retry in 864.162862ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9352024-09-23T23:11:08.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 1.302685898s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9362024-09-23T23:11:08.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 583.006352ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9372024-09-23T23:11:08.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 689.234674ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9382024-09-23T23:11:09.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e") failed: Property not found. retry in 513.979107ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9392024-09-23T23:11:09.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1") failed: Property not found. retry in 1.492982972s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
9402024-09-23T23:11:09.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 778.291055ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9412024-09-23T23:11:09.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 1.157737241s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9422024-09-23T23:11:09.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e") failed: Property not found. retry in 1.46636252s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9432024-09-23T23:11:09.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 1.174227183s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9442024-09-23T23:11:10.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 940.251447ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9452024-09-23T23:11:10.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 1.225281512s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9462024-09-23T23:11:10.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1") failed: Property not found. retry in 817.075519ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
9472024-09-23T23:11:11.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 621.997132ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9482024-09-23T23:11:11.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 866.154182ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9492024-09-23T23:11:11.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e") failed: Property not found. retry in 1.020363712s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9502024-09-23T23:11:11.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1") failed: Property not found. retry in 691.549694ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
9512024-09-23T23:11:11.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 511.272225ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9522024-09-23T23:11:11.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 537.279845ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9532024-09-23T23:11:12.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 777.894338ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9542024-09-23T23:11:12.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 1.421955246s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9552024-09-23T23:11:12.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e") failed: Property not found. retry in 1.311424446s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9562024-09-23T23:11:12.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1") failed: Property not found. retry in 1.389666228s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
9572024-09-23T23:11:12.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 1.446980722s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9582024-09-23T23:11:12.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 1.353563846s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9592024-09-23T23:11:13.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 663.640829ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9602024-09-23T23:11:13.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 979.624972ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9612024-09-23T23:11:14.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 538.02437ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9622024-09-23T23:11:14.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 1.328730605s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9632024-09-23T23:11:14.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 520.022294ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9642024-09-23T23:11:14.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 639.181658ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9652024-09-23T23:11:15.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 727.243479ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9662024-09-23T23:11:15.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 1.239805836s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9672024-09-23T23:11:15.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 1.413545739s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9682024-09-23T23:11:16.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 517.940093ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9692024-09-23T23:11:16.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 1.057851317s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9702024-09-23T23:11:16.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 1.090095448s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9712024-09-23T23:11:17.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 1.134199498s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9722024-09-23T23:11:17.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 900.290486ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9732024-09-23T23:11:17.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 927.504754ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9742024-09-23T23:11:18.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 1.093246829s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9752024-09-23T23:11:18.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 578.160679ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9762024-09-23T23:11:18.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 835.657328ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9772024-09-23T23:11:19.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 778.07003ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9782024-09-23T23:11:19.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 701.15179ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9792024-09-23T23:11:19.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 928.16068ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9802024-09-23T23:11:20.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 782.90916ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9812024-09-23T23:11:20.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 1.004665769s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9822024-09-23T23:11:20.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 925.601723ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9832024-09-23T23:11:20.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 1.207778881s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9842024-09-23T23:11:21.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 1.205526205s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9852024-09-23T23:11:21.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 1.486021856s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9862024-09-23T23:11:21.779ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 17.881922078s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
9872024-09-23T23:11:22.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 1.04486042s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9882024-09-23T23:11:22.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522") failed: Property not found. retry in 1.466759347s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9892024-09-23T23:11:23.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c") failed: Property not found. retry in 1.005330741s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9902024-09-23T23:11:23.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f") failed: Property not found. retry in 1.196196194s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9912024-09-23T23:11:24.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_cockroachdb_aa048210-e58e-499f-9625-fe41caf5296f
9922024-09-23T23:11:24.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_cockroachdb_edfcb679-1fe3-472b-a9da-78c2f419290c
9932024-09-23T23:11:24.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_cockroachdb_5de84641-2340-4c69-af19-09fcc80de08e
9942024-09-23T23:11:24.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_cockroachdb_819223d8-f233-41fc-b28b-2f89d285e4c1
9952024-09-23T23:11:24.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_cockroachdb_61cdf299-97b9-49df-8210-9eebf86d6522
9962024-09-23T23:11:24.405ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9972024-09-23T23:11:24.405ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9982024-09-23T23:11:24.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 23875294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61525 req_id = 85dcde80-0df6-4a3b-8e6d-926ba3e9b789 response_code = 204 uri = /omicron-zones
9992024-09-23T23:11:24.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50653
10002024-09-23T23:11:24.467ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3713
10012024-09-23T23:11:24.658ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3731
10022024-09-23T23:11:31.966ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3754
10032024-09-23T23:11:31.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7526542 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50653 req_id = db3af459-d790-43bf-befc-245c4fb56df2 response_code = 204 uri = /cockroachdb
10042024-09-23T23:11:32.016ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: c86c6776-f22d-4b00-9f43-3c9b9c343289 (service), underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b2729181-3180-4ecf-bd42-a48f1144b71d (service), underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 65799211-2178-4ef6-a14b-629ea048347e (service), underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b50fe4ad-b778-4fab-a3a7-685a6f574318 (service), underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: dba4edd6-2508-46ba-8f31-1f85c385ae5b, kind: Service { id: b50fe4ad-b778-4fab-a3a7-685a6f574318 }, name: Name("ntp-b50fe4ad-b778-4fab-a3a7-685a6f574318"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 49])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: edfcb679-1fe3-472b-a9da-78c2f419290c (service), underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External } } } }, OmicronZoneConfig { id: 5de84641-2340-4c69-af19-09fcc80de08e (service), underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External } } } }, OmicronZoneConfig { id: 819223d8-f233-41fc-b28b-2f89d285e4c1 (service), underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External } } } }, OmicronZoneConfig { id: aa048210-e58e-499f-9625-fe41caf5296f (service), underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External } } } }, OmicronZoneConfig { id: 61cdf299-97b9-49df-8210-9eebf86d6522 (service), underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External } } } }, OmicronZoneConfig { id: e3d8dede-8980-4764-ac40-c508c2ebab6c (service), underlay_address: fd00:1122:3344:101::8, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: a3ab2617-5a99-4fbe-a7d1-4d5673064c67, kind: Service { id: e3d8dede-8980-4764-ac40-c508c2ebab6c }, name: Name("external-dns-e3d8dede-8980-4764-ac40-c508c2ebab6c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 212])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 954a3d10-a2dd-433b-9252-ede695863bda (service), underlay_address: fd00:1122:3344:101::9, filesystem_pool: Some(ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 074197bc-2b3f-4fe9-94c0-14608c5dfec9, kind: Service { id: 954a3d10-a2dd-433b-9252-ede695863bda }, name: Name("external-dns-954a3d10-a2dd-433b-9252-ede695863bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: b905b025-1e4a-4a11-bf0c-620257156cd8 (service), underlay_address: fd00:1122:3344:101::a, filesystem_pool: Some(ZpoolName { id: fd5ca1dd-39f0-4844-af6b-77dcaa746e9d (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: ebf272b6-074a-4cee-a95e-216e4da4a83b, kind: Service { id: b905b025-1e4a-4a11-bf0c-620257156cd8 }, name: Name("nexus-b905b025-1e4a-4a11-bf0c-620257156cd8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 212442ce-6712-4c6a-beb4-26917e04679b (service), underlay_address: fd00:1122:3344:101::b, filesystem_pool: Some(ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: ad747b06-b112-4f84-a56c-95e2ad7cc8d4, kind: Service { id: 212442ce-6712-4c6a-beb4-26917e04679b }, name: Name("nexus-212442ce-6712-4c6a-beb4-26917e04679b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 8edf7e0a-db5e-4594-b36b-7d389db56474 (service), underlay_address: fd00:1122:3344:101::c, filesystem_pool: Some(ZpoolName { id: ef338e61-2c72-4f07-92cd-da33ab2266a6 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 12e743bf-60f7-4d25-9b2b-595ff259882d, kind: Service { id: 8edf7e0a-db5e-4594-b36b-7d389db56474 }, name: Name("nexus-8edf7e0a-db5e-4594-b36b-7d389db56474"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: b1b00c55-180a-49a6-8247-29e381ecf42d (service), underlay_address: fd00:1122:3344:101::d, filesystem_pool: Some(ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63 (service), underlay_address: fd00:1122:3344:101::e, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External } } } }, OmicronZoneConfig { id: d04d138d-f307-4152-86f9-2f578b958978 (service), underlay_address: fd00:1122:3344:101::f, filesystem_pool: Some(ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 7300ee9b-dcec-4cd9-afee-4935a43e803d (service), underlay_address: fd00:1122:3344:101::10, filesystem_pool: Some(ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: aa88cf81-d727-4e19-bd63-38f1fc37cdd3 (service), underlay_address: fd00:1122:3344:101::11, filesystem_pool: Some(ZpoolName { id: ce967aab-6630-4925-b90b-9c9cb48e90c0 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 2021e4db-ac4e-4c53-aefe-4b4a4cee329f (service), underlay_address: fd00:1122:3344:101::12, filesystem_pool: Some(ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External } } } }, OmicronZoneConfig { id: c862f8c9-0ecd-45c2-b556-070743c225b6 (service), underlay_address: fd00:1122:3344:101::13, filesystem_pool: Some(ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External } } } }, OmicronZoneConfig { id: 63847a61-061a-4155-84f8-b066c5b4e035 (service), underlay_address: fd00:1122:3344:101::14, filesystem_pool: Some(ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External } } } }, OmicronZoneConfig { id: bf16b0f2-13a2-49a5-9700-bbce43d9c5d0 (service), underlay_address: fd00:1122:3344:101::15, filesystem_pool: Some(ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External } } } }, OmicronZoneConfig { id: ec6e51cd-fb03-46ba-babc-4aa3fc3244c1 (service), underlay_address: fd00:1122:3344:101::16, filesystem_pool: Some(ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External } } } }, OmicronZoneConfig { id: c08193c1-677d-424a-b7e3-47f8ed6c514f (service), underlay_address: fd00:1122:3344:101::17, filesystem_pool: Some(ZpoolName { id: ce967aab-6630-4925-b90b-9c9cb48e90c0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ce967aab-6630-4925-b90b-9c9cb48e90c0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3a08792a-4a03-479c-8556-d27ce039902e (service), underlay_address: fd00:1122:3344:101::18, filesystem_pool: Some(ZpoolName { id: fd5ca1dd-39f0-4844-af6b-77dcaa746e9d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd5ca1dd-39f0-4844-af6b-77dcaa746e9d (zpool), kind: External } } } }, OmicronZoneConfig { id: 3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80 (service), underlay_address: fd00:1122:3344:101::19, filesystem_pool: Some(ZpoolName { id: ef338e61-2c72-4f07-92cd-da33ab2266a6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef338e61-2c72-4f07-92cd-da33ab2266a6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 46ddf6ac-e0eb-4eed-ade3-abef88f1df83 (service), underlay_address: fd00:1122:3344:101::1a, filesystem_pool: Some(ZpoolName { id: 1be25b7d-d663-491f-9b22-294625b9b9ed (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1be25b7d-d663-491f-9b22-294625b9b9ed (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:458 sled_address = [fd00:1122:3344:101::1]:12345
10052024-09-23T23:11:32.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64903
10062024-09-23T23:11:32.019ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c86c6776-f22d-4b00-9f43-3c9b9c343289, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10072024-09-23T23:11:32.019ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: c86c6776-f22d-4b00-9f43-3c9b9c343289, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: InternalDns }, responder: ... }
10082024-09-23T23:11:32.060ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b2729181-3180-4ecf-bd42-a48f1144b71d, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10092024-09-23T23:11:32.060ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: b2729181-3180-4ecf-bd42-a48f1144b71d, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: InternalDns }, responder: ... }
10102024-09-23T23:11:32.090ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 65799211-2178-4ef6-a14b-629ea048347e, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10112024-09-23T23:11:32.090ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 65799211-2178-4ef6-a14b-629ea048347e, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: InternalDns }, responder: ... }
10122024-09-23T23:11:32.123ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edfcb679-1fe3-472b-a9da-78c2f419290c, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10132024-09-23T23:11:32.123ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: edfcb679-1fe3-472b-a9da-78c2f419290c, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10142024-09-23T23:11:32.152ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5de84641-2340-4c69-af19-09fcc80de08e, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10152024-09-23T23:11:32.152ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 5de84641-2340-4c69-af19-09fcc80de08e, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: Cockroach }, responder: ... }
10162024-09-23T23:11:32.178ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 819223d8-f233-41fc-b28b-2f89d285e4c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10172024-09-23T23:11:32.178ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 819223d8-f233-41fc-b28b-2f89d285e4c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10182024-09-23T23:11:32.209ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aa048210-e58e-499f-9625-fe41caf5296f, dataset_name: DatasetName { pool_name: ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10192024-09-23T23:11:32.209ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: aa048210-e58e-499f-9625-fe41caf5296f, dataset_name: DatasetName { pool_name: ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External }, kind: Cockroach }, responder: ... }
10202024-09-23T23:11:32.239ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 61cdf299-97b9-49df-8210-9eebf86d6522, dataset_name: DatasetName { pool_name: ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10212024-09-23T23:11:32.239ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 61cdf299-97b9-49df-8210-9eebf86d6522, dataset_name: DatasetName { pool_name: ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10222024-09-23T23:11:32.268ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e3d8dede-8980-4764-ac40-c508c2ebab6c, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10232024-09-23T23:11:32.268ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: e3d8dede-8980-4764-ac40-c508c2ebab6c, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10242024-09-23T23:11:32.371ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 954a3d10-a2dd-433b-9252-ede695863bda, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10252024-09-23T23:11:32.371ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 954a3d10-a2dd-433b-9252-ede695863bda, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10262024-09-23T23:11:32.485ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:451
10272024-09-23T23:11:32.485ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10282024-09-23T23:11:32.589ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2021e4db-ac4e-4c53-aefe-4b4a4cee329f, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10292024-09-23T23:11:32.589ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 2021e4db-ac4e-4c53-aefe-4b4a4cee329f, dataset_name: DatasetName { pool_name: ZpoolName { id: 3877506b-1f39-42fc-94ac-b2d382e6869a (zpool), kind: External }, kind: Crucible }, responder: ... }
10302024-09-23T23:11:32.683ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c862f8c9-0ecd-45c2-b556-070743c225b6, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10312024-09-23T23:11:32.683ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: c862f8c9-0ecd-45c2-b556-070743c225b6, dataset_name: DatasetName { pool_name: ZpoolName { id: f28e76df-bcff-4355-b674-7f6f05c9f8dc (zpool), kind: External }, kind: Crucible }, responder: ... }
10322024-09-23T23:11:32.784ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 63847a61-061a-4155-84f8-b066c5b4e035, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10332024-09-23T23:11:32.784ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 63847a61-061a-4155-84f8-b066c5b4e035, dataset_name: DatasetName { pool_name: ZpoolName { id: 27622737-fd47-4a66-a552-1d64c0d56a2b (zpool), kind: External }, kind: Crucible }, responder: ... }
10342024-09-23T23:11:32.880ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bf16b0f2-13a2-49a5-9700-bbce43d9c5d0, dataset_name: DatasetName { pool_name: ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10352024-09-23T23:11:32.880ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: bf16b0f2-13a2-49a5-9700-bbce43d9c5d0, dataset_name: DatasetName { pool_name: ZpoolName { id: 82bc7793-c675-49d9-9db9-2f4a2a329bef (zpool), kind: External }, kind: Crucible }, responder: ... }
10362024-09-23T23:11:32.981ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ec6e51cd-fb03-46ba-babc-4aa3fc3244c1, dataset_name: DatasetName { pool_name: ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10372024-09-23T23:11:32.981ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: ec6e51cd-fb03-46ba-babc-4aa3fc3244c1, dataset_name: DatasetName { pool_name: ZpoolName { id: d78e334d-0261-40af-8332-4a45fd2a8d42 (zpool), kind: External }, kind: Crucible }, responder: ... }
10382024-09-23T23:11:33.082ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c08193c1-677d-424a-b7e3-47f8ed6c514f, dataset_name: DatasetName { pool_name: ZpoolName { id: ce967aab-6630-4925-b90b-9c9cb48e90c0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10392024-09-23T23:11:33.082ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: c08193c1-677d-424a-b7e3-47f8ed6c514f, dataset_name: DatasetName { pool_name: ZpoolName { id: ce967aab-6630-4925-b90b-9c9cb48e90c0 (zpool), kind: External }, kind: Crucible }, responder: ... }
10402024-09-23T23:11:33.177ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3a08792a-4a03-479c-8556-d27ce039902e, dataset_name: DatasetName { pool_name: ZpoolName { id: fd5ca1dd-39f0-4844-af6b-77dcaa746e9d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10412024-09-23T23:11:33.177ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 3a08792a-4a03-479c-8556-d27ce039902e, dataset_name: DatasetName { pool_name: ZpoolName { id: fd5ca1dd-39f0-4844-af6b-77dcaa746e9d (zpool), kind: External }, kind: Crucible }, responder: ... }
10422024-09-23T23:11:33.271ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80, dataset_name: DatasetName { pool_name: ZpoolName { id: ef338e61-2c72-4f07-92cd-da33ab2266a6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10432024-09-23T23:11:33.271ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80, dataset_name: DatasetName { pool_name: ZpoolName { id: ef338e61-2c72-4f07-92cd-da33ab2266a6 (zpool), kind: External }, kind: Crucible }, responder: ... }
10442024-09-23T23:11:33.364ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 46ddf6ac-e0eb-4eed-ade3-abef88f1df83, dataset_name: DatasetName { pool_name: ZpoolName { id: 1be25b7d-d663-491f-9b22-294625b9b9ed (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10452024-09-23T23:11:33.364ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 46ddf6ac-e0eb-4eed-ade3-abef88f1df83, dataset_name: DatasetName { pool_name: ZpoolName { id: 1be25b7d-d663-491f-9b22-294625b9b9ed (zpool), kind: External }, kind: Crucible }, responder: ... }
10462024-09-23T23:11:33.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10472024-09-23T23:11:33.462ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/omicron-zones.json file = common/src/ledger.rs:177
10482024-09-23T23:11:33.462ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/omicron-zones.json file = common/src/ledger.rs:177
10492024-09-23T23:11:33.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10502024-09-23T23:11:33.605ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
10512024-09-23T23:11:33.625ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
10522024-09-23T23:11:33.628ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
10532024-09-23T23:11:33.630ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
10542024-09-23T23:11:33.742ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10552024-09-23T23:11:33.742ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10562024-09-23T23:11:33.742ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10572024-09-23T23:11:33.742ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10582024-09-23T23:11:33.742ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10592024-09-23T23:11:33.742ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10602024-09-23T23:11:33.990ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
10612024-09-23T23:11:33.991ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10622024-09-23T23:11:33.991ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10632024-09-23T23:11:33.991ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10642024-09-23T23:11:33.991ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10652024-09-23T23:11:33.991ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10662024-09-23T23:11:33.991ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10672024-09-23T23:11:34.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10682024-09-23T23:11:34.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10692024-09-23T23:11:34.014ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6 file = illumos-utils/src/zone.rs:316
10702024-09-23T23:11:34.022ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0 file = illumos-utils/src/zone.rs:316
10712024-09-23T23:11:34.030ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1 file = illumos-utils/src/zone.rs:316
10722024-09-23T23:11:34.037ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978 file = illumos-utils/src/zone.rs:316
10732024-09-23T23:11:34.044ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83 file = illumos-utils/src/zone.rs:316
10742024-09-23T23:11:34.051ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f file = illumos-utils/src/zone.rs:316
10752024-09-23T23:11:34.350ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
10762024-09-23T23:11:34.351ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6 file = illumos-utils/src/zone.rs:354
10772024-09-23T23:11:34.360ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0 file = illumos-utils/src/zone.rs:354
10782024-09-23T23:11:34.367ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1 file = illumos-utils/src/zone.rs:354
10792024-09-23T23:11:34.374ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978 file = illumos-utils/src/zone.rs:354
10802024-09-23T23:11:34.384ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83 file = illumos-utils/src/zone.rs:354
10812024-09-23T23:11:34.393ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f file = illumos-utils/src/zone.rs:354
10822024-09-23T23:11:34.401ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80 file = illumos-utils/src/zone.rs:316
10832024-09-23T23:11:34.408ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d file = illumos-utils/src/zone.rs:316
10842024-09-23T23:11:34.416ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3 file = illumos-utils/src/zone.rs:316
10852024-09-23T23:11:34.424ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035 file = illumos-utils/src/zone.rs:316
10862024-09-23T23:11:34.432ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f file = illumos-utils/src/zone.rs:316
10872024-09-23T23:11:34.440ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63 file = illumos-utils/src/zone.rs:316
10882024-09-23T23:11:34.450ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d file = illumos-utils/src/zone.rs:316
10892024-09-23T23:11:34.459ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e file = illumos-utils/src/zone.rs:316
10902024-09-23T23:11:34.519ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
10912024-09-23T23:11:34.520ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80 file = illumos-utils/src/zone.rs:354
10922024-09-23T23:11:34.527ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d file = illumos-utils/src/zone.rs:354
10932024-09-23T23:11:34.535ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3 file = illumos-utils/src/zone.rs:354
10942024-09-23T23:11:34.541ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035 file = illumos-utils/src/zone.rs:354
10952024-09-23T23:11:34.548ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f file = illumos-utils/src/zone.rs:354
10962024-09-23T23:11:34.556ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63 file = illumos-utils/src/zone.rs:354
10972024-09-23T23:11:34.564ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d file = illumos-utils/src/zone.rs:354
10982024-09-23T23:11:34.570ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e file = illumos-utils/src/zone.rs:354
10992024-09-23T23:11:34.638ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
11002024-09-23T23:11:34.721ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
11012024-09-23T23:11:34.804ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
11022024-09-23T23:11:34.808ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
11032024-09-23T23:11:34.808ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
11042024-09-23T23:11:34.866ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 132, 27]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11052024-09-23T23:11:34.866ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1261 zone_type = nexus
11062024-09-23T23:11:34.870ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
11072024-09-23T23:11:34.870ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
11082024-09-23T23:11:34.932ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 128, 212]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11092024-09-23T23:11:34.932ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1261 zone_type = external_dns
11102024-09-23T23:11:34.934ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
11112024-09-23T23:11:34.934ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
11122024-09-23T23:11:35.000ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 155, 102]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11132024-09-23T23:11:35.000ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1261 zone_type = nexus
11142024-09-23T23:11:35.005ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
11152024-09-23T23:11:35.005ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
11162024-09-23T23:11:35.068ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 154, 221]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11172024-09-23T23:11:35.068ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1261 zone_type = nexus
11182024-09-23T23:11:35.070ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
11192024-09-23T23:11:35.070ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
11202024-09-23T23:11:35.140ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 248, 133]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11212024-09-23T23:11:35.140ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1261 zone_type = external_dns
11222024-09-23T23:11:35.140ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11232024-09-23T23:11:35.140ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11242024-09-23T23:11:35.142ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11252024-09-23T23:11:35.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11262024-09-23T23:11:35.183ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11272024-09-23T23:11:35.183ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11282024-09-23T23:11:35.183ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11292024-09-23T23:11:35.183ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11302024-09-23T23:11:35.183ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11312024-09-23T23:11:35.183ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11322024-09-23T23:11:35.184ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11332024-09-23T23:11:35.184ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11342024-09-23T23:11:35.184ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11352024-09-23T23:11:35.188ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11362024-09-23T23:11:35.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11372024-09-23T23:11:35.194ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11382024-09-23T23:11:35.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11392024-09-23T23:11:35.198ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11402024-09-23T23:11:35.201ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11412024-09-23T23:11:35.201ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11422024-09-23T23:11:35.385ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474 file = illumos-utils/src/zone.rs:316
11432024-09-23T23:11:35.404ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c file = illumos-utils/src/zone.rs:316
11442024-09-23T23:11:35.419ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b file = illumos-utils/src/zone.rs:316
11452024-09-23T23:11:35.429ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8 file = illumos-utils/src/zone.rs:316
11462024-09-23T23:11:35.441ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda file = illumos-utils/src/zone.rs:316
11472024-09-23T23:11:35.454ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474 file = illumos-utils/src/zone.rs:354
11482024-09-23T23:11:35.464ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c file = illumos-utils/src/zone.rs:354
11492024-09-23T23:11:35.475ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b file = illumos-utils/src/zone.rs:354
11502024-09-23T23:11:35.487ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8 file = illumos-utils/src/zone.rs:354
11512024-09-23T23:11:35.502ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda file = illumos-utils/src/zone.rs:354
11522024-09-23T23:11:37.171ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59496
11532024-09-23T23:11:37.172ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 434 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59496 req_id = de0e8fb1-d68b-4704-ac2c-64def943fb83 response_code = 200 uri = /baseboard
11542024-09-23T23:11:38.273ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11552024-09-23T23:11:38.273ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
11562024-09-23T23:11:38.584ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_82bc7793-c675-49d9-9db9-2f4a2a329bef/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='674c8bdd-2b6b-4650-af71-821f795ddcae'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11572024-09-23T23:11:38.584ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
11582024-09-23T23:11:38.594ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d78e334d-0261-40af-8332-4a45fd2a8d42/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='03f7371e-0b93-478b-b35e-5d17cc2fd19c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11592024-09-23T23:11:38.595ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1be25b7d-d663-491f-9b22-294625b9b9ed/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4158fcc5-d1e1-4414-9fec-3a69325999d0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11602024-09-23T23:11:38.595ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ce967aab-6630-4925-b90b-9c9cb48e90c0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ef8f4f7c-17ec-4e28-acb0-724c2b2084c8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11612024-09-23T23:11:38.595ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ef338e61-2c72-4f07-92cd-da33ab2266a6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a9260033-e3a5-4751-949b-3dd64f92f894'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11622024-09-23T23:11:38.595ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fd5ca1dd-39f0-4844-af6b-77dcaa746e9d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e7ee50cb-28c3-4c79-9b8a-2c7abfe2d2c8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11632024-09-23T23:11:38.596ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f28e76df-bcff-4355-b674-7f6f05c9f8dc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='87ef549d-a17e-4af5-a70d-6be4773f13d1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11642024-09-23T23:11:38.596ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
11652024-09-23T23:11:38.604ZINFOSledAgent (ServiceManager): Booting oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
11662024-09-23T23:11:38.611ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
11672024-09-23T23:11:38.619ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
11682024-09-23T23:11:38.626ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
11692024-09-23T23:11:38.635ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
11702024-09-23T23:11:38.703ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='b1b00c55-180a-49a6-8247-29e381ecf42d'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11712024-09-23T23:11:38.703ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
11722024-09-23T23:11:38.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 52.140531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
11732024-09-23T23:11:38.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 58.40593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
11742024-09-23T23:11:38.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 65.912939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
11752024-09-23T23:11:38.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 25.646936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
11762024-09-23T23:11:38.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 51.776344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
11772024-09-23T23:11:38.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 54.641285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
11782024-09-23T23:11:38.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 46.364106ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
11792024-09-23T23:11:39.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 57.959566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
11802024-09-23T23:11:39.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 97.584646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
11812024-09-23T23:11:46.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 94.374158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
11822024-09-23T23:11:46.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 57.882674ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
11832024-09-23T23:11:47.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 90.627707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
11842024-09-23T23:11:47.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 94.659183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
11852024-09-23T23:11:47.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 225.908428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
11862024-09-23T23:11:47.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 94.192906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
11872024-09-23T23:11:48.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 238.953895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
11882024-09-23T23:11:48.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 144.18873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
11892024-09-23T23:11:48.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 80.737332ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
11902024-09-23T23:11:48.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 102.695626ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
11912024-09-23T23:11:48.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 84.932069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
11922024-09-23T23:11:48.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 169.549945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
11932024-09-23T23:11:48.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 289.697006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
11942024-09-23T23:11:48.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 268.146232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
11952024-09-23T23:11:48.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 174.361762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
11962024-09-23T23:11:48.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 199.754733ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
11972024-09-23T23:11:48.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 276.599369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
11982024-09-23T23:11:48.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 194.50121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
11992024-09-23T23:11:48.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 466.550981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
12002024-09-23T23:11:48.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 308.76179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
12012024-09-23T23:11:48.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 280.748289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
12022024-09-23T23:11:48.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 436.774721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
12032024-09-23T23:11:48.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 423.984173ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
12042024-09-23T23:11:48.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 460.258042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
12052024-09-23T23:11:48.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 290.376646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
12062024-09-23T23:11:48.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 792.168021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
12072024-09-23T23:11:48.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 224.382068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
12082024-09-23T23:11:48.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 503.955148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
12092024-09-23T23:11:48.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 1.184786944s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
12102024-09-23T23:11:48.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.066248732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
12112024-09-23T23:11:48.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 472.643584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
12122024-09-23T23:11:48.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 682.204993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
12132024-09-23T23:11:49.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 640.575271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
12142024-09-23T23:11:49.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 945.709522ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
12152024-09-23T23:11:49.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 879.368601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
12162024-09-23T23:11:49.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 472.612087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
12172024-09-23T23:11:49.302ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12182024-09-23T23:11:49.323ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
12192024-09-23T23:11:49.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 603.121711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
12202024-09-23T23:11:49.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 552.247503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
12212024-09-23T23:11:49.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 33.554781ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
12222024-09-23T23:11:49.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.230352596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
12232024-09-23T23:11:49.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 127.733232ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
12242024-09-23T23:11:49.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 1.468653847s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
12252024-09-23T23:11:49.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 981.836156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
12262024-09-23T23:11:49.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 179.037548ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
12272024-09-23T23:11:49.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.056425192s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
12282024-09-23T23:11:50.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 1.127516504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
12292024-09-23T23:11:50.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.374366707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
12302024-09-23T23:11:50.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 553.380646ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
12312024-09-23T23:11:50.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 949.905757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
12322024-09-23T23:11:50.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.316712327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
12332024-09-23T23:11:50.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 1.036713674s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
12342024-09-23T23:11:50.425ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_27622737-fd47-4a66-a552-1d64c0d56a2b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3a7ca1bf-276d-4c33-8e7f-0489f92050f7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12352024-09-23T23:11:50.425ZINFOSledAgent (ServiceManager): Booting oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
12362024-09-23T23:11:50.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.131960495s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
12372024-09-23T23:11:50.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 37.024356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
12382024-09-23T23:11:50.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 57.694568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
12392024-09-23T23:11:50.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 714.784643ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
12402024-09-23T23:11:50.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 112.205782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
12412024-09-23T23:11:50.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 520.585829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
12422024-09-23T23:11:50.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 596.411381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
12432024-09-23T23:11:50.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 851.574075ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
12442024-09-23T23:11:51.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.446421794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
12452024-09-23T23:11:51.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 976.582261ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
12462024-09-23T23:11:51.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 1.101249676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
12472024-09-23T23:11:51.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 992.836627ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
12482024-09-23T23:11:51.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.482971046s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
12492024-09-23T23:11:51.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 713.63233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
12502024-09-23T23:11:51.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 843.129053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
12512024-09-23T23:11:51.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.423529177s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
12522024-09-23T23:11:51.494ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12532024-09-23T23:11:51.494ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12542024-09-23T23:11:51.495ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
12552024-09-23T23:11:51.500ZINFOSledAgent (ServiceManager): Booting oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
12562024-09-23T23:11:51.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.348764875s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
12572024-09-23T23:11:51.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 42.727487ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
12582024-09-23T23:11:51.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 74.862499ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
12592024-09-23T23:11:51.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 82.402495ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
12602024-09-23T23:11:51.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.086612508s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
12612024-09-23T23:11:51.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 127.778511ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
12622024-09-23T23:11:51.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.180378425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
12632024-09-23T23:11:51.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 107.873852ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
12642024-09-23T23:11:51.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 132.287807ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
12652024-09-23T23:11:51.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 243.84176ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
12662024-09-23T23:11:52.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 267.52295ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
12672024-09-23T23:11:52.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 1.296772677s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
12682024-09-23T23:11:52.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.358336746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
12692024-09-23T23:11:52.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 1.093525659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
12702024-09-23T23:11:52.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 638.462427ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
12712024-09-23T23:11:52.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 1.450950705s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
12722024-09-23T23:11:52.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 914.078873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
12732024-09-23T23:11:52.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 594.363186ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
12742024-09-23T23:11:52.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.399197125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
12752024-09-23T23:11:52.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.077984872s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
12762024-09-23T23:11:52.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 655.977238ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
12772024-09-23T23:11:52.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.12506035s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
12782024-09-23T23:11:52.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.040916628s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
12792024-09-23T23:11:52.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.27032001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
12802024-09-23T23:11:52.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.339631808s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
12812024-09-23T23:11:53.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.492330744s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
12822024-09-23T23:11:53.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.468409198s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
12832024-09-23T23:11:53.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 958.663524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
12842024-09-23T23:11:53.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 758.012988ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
12852024-09-23T23:11:53.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 930.505433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
12862024-09-23T23:11:53.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 899.540006ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
12872024-09-23T23:11:53.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 972.606788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
12882024-09-23T23:11:53.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 548.137205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
12892024-09-23T23:11:53.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 844.382211ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
12902024-09-23T23:11:53.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 961.689917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
12912024-09-23T23:11:54.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 885.248776ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
12922024-09-23T23:11:54.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 898.398884ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
12932024-09-23T23:11:54.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.260497579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
12942024-09-23T23:11:54.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 1.318100315s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
12952024-09-23T23:11:54.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 524.550978ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
12962024-09-23T23:11:54.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.04931458s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
12972024-09-23T23:11:54.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 1.252995854s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
12982024-09-23T23:11:54.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.064226431s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
12992024-09-23T23:11:54.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.440970039s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
13002024-09-23T23:11:54.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.462507462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
13012024-09-23T23:11:54.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 722.007485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
13022024-09-23T23:11:54.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.029068406s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
13032024-09-23T23:11:55.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 608.784966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
13042024-09-23T23:11:55.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.052248383s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
13052024-09-23T23:11:55.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.461674594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
13062024-09-23T23:11:55.151ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13072024-09-23T23:11:55.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 676.241756ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
13082024-09-23T23:11:55.190ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3877506b-1f39-42fc-94ac-b2d382e6869a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5dc85eaa-639a-42f7-ac4e-4f544a67ba8f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13092024-09-23T23:11:55.190ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13102024-09-23T23:11:55.190ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
13112024-09-23T23:11:55.198ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
13122024-09-23T23:11:55.207ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
13132024-09-23T23:11:55.220ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13142024-09-23T23:11:55.220ZINFOSledAgent (ServiceManager): Booting oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
13152024-09-23T23:11:55.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 1.449691333s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
13162024-09-23T23:11:55.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.405141925s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
13172024-09-23T23:11:55.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.16055167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
13182024-09-23T23:11:55.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.381696327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
13192024-09-23T23:11:55.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 807.167187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
13202024-09-23T23:11:55.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 944.986002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
13212024-09-23T23:11:55.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 59.097592ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
13222024-09-23T23:11:55.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 718.691336ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
13232024-09-23T23:11:55.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 63.176888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
13242024-09-23T23:11:55.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 47.660978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
13252024-09-23T23:11:55.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 55.050997ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
13262024-09-23T23:11:55.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 26.641918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
13272024-09-23T23:11:55.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 53.359684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
13282024-09-23T23:11:55.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 96.392916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
13292024-09-23T23:11:55.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 55.335872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
13302024-09-23T23:11:55.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 238.926462ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
13312024-09-23T23:11:55.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 130.740551ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
13322024-09-23T23:11:55.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 869.244458ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
13332024-09-23T23:11:55.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 221.178556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
13342024-09-23T23:11:55.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 119.011983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
13352024-09-23T23:11:55.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.033554067s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
13362024-09-23T23:11:55.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 586.774526ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
13372024-09-23T23:11:56.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 275.907092ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
13382024-09-23T23:11:56.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 508.43766ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
13392024-09-23T23:11:56.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 561.700676ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
13402024-09-23T23:11:56.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 568.42369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
13412024-09-23T23:11:56.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 762.920158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
13422024-09-23T23:11:56.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.24409396s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
13432024-09-23T23:11:56.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 1.001530493s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
13442024-09-23T23:11:56.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 966.402769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
13452024-09-23T23:11:56.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 733.61793ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
13462024-09-23T23:11:56.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 476.406839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
13472024-09-23T23:11:56.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 733.393388ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
13482024-09-23T23:11:56.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.080186952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
13492024-09-23T23:11:56.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.330831102s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
13502024-09-23T23:11:56.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 424.170613ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
13512024-09-23T23:11:56.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 534.713743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
13522024-09-23T23:11:56.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 513.931831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
13532024-09-23T23:11:56.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 950.566086ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
13542024-09-23T23:11:56.759ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552024-09-23T23:11:56.759ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
13562024-09-23T23:11:56.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 814.731354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
13572024-09-23T23:11:56.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 668.103094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
13582024-09-23T23:11:56.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 617.782433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
13592024-09-23T23:11:56.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.16098199s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
13602024-09-23T23:11:56.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 66.187082ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
13612024-09-23T23:11:57.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 102.000138ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
13622024-09-23T23:11:57.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.440612133s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
13632024-09-23T23:11:57.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 1.303264562s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
13642024-09-23T23:11:57.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 851.095334ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
13652024-09-23T23:11:57.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 148.920613ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
13662024-09-23T23:11:57.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 796.133296ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
13672024-09-23T23:11:57.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.454694469s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
13682024-09-23T23:11:57.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 963.65133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
13692024-09-23T23:11:57.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 430.625904ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
13702024-09-23T23:11:57.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 960.833502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
13712024-09-23T23:11:57.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.0486672s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
13722024-09-23T23:11:57.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 1.219102441s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
13732024-09-23T23:11:57.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.117437001s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
13742024-09-23T23:11:57.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 594.980183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
13752024-09-23T23:11:57.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 808.30341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
13762024-09-23T23:11:57.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.044190407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
13772024-09-23T23:11:57.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 898.074413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
13782024-09-23T23:11:57.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 637.744023ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
13792024-09-23T23:11:57.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 1.128285791s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
13802024-09-23T23:11:57.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 1.215307652s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
13812024-09-23T23:11:57.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 860.561402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
13822024-09-23T23:11:57.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 1.268668246s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
13832024-09-23T23:11:58.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.325502335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
13842024-09-23T23:11:58.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 868.829411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
13852024-09-23T23:11:58.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 1.295193661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
13862024-09-23T23:11:58.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 938.6764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
13872024-09-23T23:11:58.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 739.99897ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
13882024-09-23T23:11:58.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 1.345158971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
13892024-09-23T23:11:58.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.067074447s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
13902024-09-23T23:11:58.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 819.497203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
13912024-09-23T23:11:58.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.066627596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
13922024-09-23T23:11:58.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 919.607077ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
13932024-09-23T23:11:58.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.327847526s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
13942024-09-23T23:11:58.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 1.328981511s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
13952024-09-23T23:11:58.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.347118785s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
13962024-09-23T23:11:58.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 641.152767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
13972024-09-23T23:11:58.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.26650981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
13982024-09-23T23:11:58.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 1.199515107s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
13992024-09-23T23:11:59.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.426514708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
14002024-09-23T23:11:59.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 1.225011207s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
14012024-09-23T23:11:59.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 939.378258ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
14022024-09-23T23:11:59.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 1.35322377s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
14032024-09-23T23:11:59.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 774.460928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
14042024-09-23T23:11:59.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 762.662505ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
14052024-09-23T23:11:59.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.265431544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
14062024-09-23T23:11:59.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 888.269979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
14072024-09-23T23:11:59.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.170105886s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
14082024-09-23T23:11:59.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 769.992357ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
14092024-09-23T23:11:59.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 616.36128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
14102024-09-23T23:11:59.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 739.856283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
14112024-09-23T23:11:59.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 964.953574ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
14122024-09-23T23:11:59.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.389399024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
14132024-09-23T23:11:59.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 678.619816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
14142024-09-23T23:12:00.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 1.353225965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
14152024-09-23T23:12:00.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 953.845609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
14162024-09-23T23:12:00.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 916.672046ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
14172024-09-23T23:12:00.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 972.503695ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
14182024-09-23T23:12:00.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 964.567178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
14192024-09-23T23:12:00.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 1.333858135s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
14202024-09-23T23:12:00.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 1.463485442s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
14212024-09-23T23:12:00.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.447220426s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
14222024-09-23T23:12:00.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.376510187s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
14232024-09-23T23:12:00.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.086753846s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
14242024-09-23T23:12:00.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 1.285873952s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
14252024-09-23T23:12:00.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.219484859s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
14262024-09-23T23:12:00.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 999.457683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
14272024-09-23T23:12:00.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 765.643952ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
14282024-09-23T23:12:00.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 1.045048386s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
14292024-09-23T23:12:00.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.397216215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
14302024-09-23T23:12:00.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 930.632622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
14312024-09-23T23:12:00.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 1.414346728s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
14322024-09-23T23:12:01.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.223906579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
14332024-09-23T23:12:01.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 1.492116971s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
14342024-09-23T23:12:01.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.011676101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
14352024-09-23T23:12:01.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.303511741s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
14362024-09-23T23:12:01.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 904.111528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
14372024-09-23T23:12:01.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.228542077s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
14382024-09-23T23:12:01.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 599.449597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
14392024-09-23T23:12:01.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 1.018056919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
14402024-09-23T23:12:01.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 868.695026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
14412024-09-23T23:12:01.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 761.272607ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
14422024-09-23T23:12:01.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 1.262241375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
14432024-09-23T23:12:01.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 694.842615ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
14442024-09-23T23:12:01.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 727.246213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
14452024-09-23T23:12:01.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 573.95892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
14462024-09-23T23:12:01.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 1.333729882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
14472024-09-23T23:12:01.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.18844358s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
14482024-09-23T23:12:02.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 958.948136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
14492024-09-23T23:12:02.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 985.664805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
14502024-09-23T23:12:02.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 567.280214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
14512024-09-23T23:12:02.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.240873267s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
14522024-09-23T23:12:02.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.418366673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
14532024-09-23T23:12:02.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 979.777747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
14542024-09-23T23:12:02.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 1.02052174s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
14552024-09-23T23:12:02.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 759.553852ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
14562024-09-23T23:12:02.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 826.562302ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
14572024-09-23T23:12:02.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.017963189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
14582024-09-23T23:12:02.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 1.326199457s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
14592024-09-23T23:12:02.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 926.061663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
14602024-09-23T23:12:02.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 655.321159ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
14612024-09-23T23:12:02.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.189091245s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
14622024-09-23T23:12:02.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 786.815369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
14632024-09-23T23:12:02.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.18661716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
14642024-09-23T23:12:02.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 617.255606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
14652024-09-23T23:12:02.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 518.733411ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
14662024-09-23T23:12:03.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.0922993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
14672024-09-23T23:12:03.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 511.717531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
14682024-09-23T23:12:03.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 821.117906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
14692024-09-23T23:12:03.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 929.838644ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
14702024-09-23T23:12:03.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 1.497735162s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
14712024-09-23T23:12:03.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 753.584176ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
14722024-09-23T23:12:03.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 964.304044ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
14732024-09-23T23:12:03.358ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 20.5743329s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
14742024-09-23T23:12:03.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 884.062531ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
14752024-09-23T23:12:03.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 900.115004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
14762024-09-23T23:12:03.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 995.564941ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
14772024-09-23T23:12:03.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.389454062s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
14782024-09-23T23:12:03.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 605.251679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
14792024-09-23T23:12:03.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.166437715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
14802024-09-23T23:12:03.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 1.155587346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
14812024-09-23T23:12:03.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 782.580322ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
14822024-09-23T23:12:03.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.361964598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
14832024-09-23T23:12:03.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 619.768233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
14842024-09-23T23:12:03.843ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide//opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14852024-09-23T23:12:03.843ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
14862024-09-23T23:12:03.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.465876471s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
14872024-09-23T23:12:03.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 699.77325ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
14882024-09-23T23:12:03.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.413387702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
14892024-09-23T23:12:04.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 539.935575ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
14902024-09-23T23:12:04.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 57.136728ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
14912024-09-23T23:12:04.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 133.201413ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
14922024-09-23T23:12:04.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.145053252s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
14932024-09-23T23:12:04.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 929.192051ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
14942024-09-23T23:12:04.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 969.739226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
14952024-09-23T23:12:04.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 236.452017ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
14962024-09-23T23:12:04.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 1.176401472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
14972024-09-23T23:12:04.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 1.349762951s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
14982024-09-23T23:12:04.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 772.654801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
14992024-09-23T23:12:04.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 985.62599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
15002024-09-23T23:12:04.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 1.497531379s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
15012024-09-23T23:12:04.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.491380039s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
15022024-09-23T23:12:04.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 490.226732ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
15032024-09-23T23:12:04.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 1.077068842s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
15042024-09-23T23:12:04.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 664.054991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
15052024-09-23T23:12:04.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.317741997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
15062024-09-23T23:12:04.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 709.599432ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
15072024-09-23T23:12:04.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 1.407850857s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
15082024-09-23T23:12:04.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.356808314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
15092024-09-23T23:12:04.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 996.657525ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
15102024-09-23T23:12:05.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 1.31503584s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
15112024-09-23T23:12:05.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.203781671s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
15122024-09-23T23:12:05.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.068548592s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
15132024-09-23T23:12:05.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 1.037474109s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
15142024-09-23T23:12:05.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.161185215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
15152024-09-23T23:12:05.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 700.899111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
15162024-09-23T23:12:05.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.29691107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
15172024-09-23T23:12:05.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.198494714s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
15182024-09-23T23:12:05.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 1.121301842s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
15192024-09-23T23:12:05.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 1.202519676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
15202024-09-23T23:12:05.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 1.210185824s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
15212024-09-23T23:12:05.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 876.455887ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
15222024-09-23T23:12:05.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 1.301513162s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
15232024-09-23T23:12:05.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 1.492770547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
15242024-09-23T23:12:05.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 541.612875ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
15252024-09-23T23:12:05.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 607.039642ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
15262024-09-23T23:12:05.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 849.658266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
15272024-09-23T23:12:06.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.257504532s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
15282024-09-23T23:12:06.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 1.130446274s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
15292024-09-23T23:12:06.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 903.478525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
15302024-09-23T23:12:06.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.479931293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
15312024-09-23T23:12:06.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 743.22784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
15322024-09-23T23:12:06.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 850.301369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
15332024-09-23T23:12:06.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 655.058689ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
15342024-09-23T23:12:06.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 515.700739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
15352024-09-23T23:12:06.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 770.033178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
15362024-09-23T23:12:06.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.240640208s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
15372024-09-23T23:12:06.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 1.182574526s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
15382024-09-23T23:12:06.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 683.641077ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
15392024-09-23T23:12:06.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 1.13875182s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
15402024-09-23T23:12:06.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.487833237s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
15412024-09-23T23:12:06.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 1.083032001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
15422024-09-23T23:12:06.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 1.068087792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
15432024-09-23T23:12:06.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.372006745s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
15442024-09-23T23:12:06.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 974.752849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
15452024-09-23T23:12:06.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 1.071103472s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
15462024-09-23T23:12:06.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.116260325s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
15472024-09-23T23:12:07.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 1.193093737s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
15482024-09-23T23:12:07.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 1.418497205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
15492024-09-23T23:12:07.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 524.415335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
15502024-09-23T23:12:07.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 727.398026ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
15512024-09-23T23:12:07.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 813.825346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
15522024-09-23T23:12:07.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 983.307494ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
15532024-09-23T23:12:07.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 984.504788ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
15542024-09-23T23:12:07.293ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59871
15552024-09-23T23:12:07.300ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4995 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59871 req_id = 97af1391-e528-4f55-b948-aad67eaeea6b response_code = 200 uri = /baseboard
15562024-09-23T23:12:07.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 1.43597793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
15572024-09-23T23:12:07.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 733.459532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
15582024-09-23T23:12:07.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.140349428s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
15592024-09-23T23:12:07.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 876.389015ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
15602024-09-23T23:12:07.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 1.339429891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
15612024-09-23T23:12:07.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 966.41062ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
15622024-09-23T23:12:07.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 979.927646ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
15632024-09-23T23:12:07.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.03589436s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
15642024-09-23T23:12:07.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 907.407997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
15652024-09-23T23:12:07.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.022975371s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
15662024-09-23T23:12:08.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 724.898243ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
15672024-09-23T23:12:08.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 739.253178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
15682024-09-23T23:12:08.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.251516065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
15692024-09-23T23:12:08.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 597.749086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
15702024-09-23T23:12:08.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.417755828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
15712024-09-23T23:12:08.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 1.027726189s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
15722024-09-23T23:12:08.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 789.569988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
15732024-09-23T23:12:08.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 1.073370693s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
15742024-09-23T23:12:08.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 604.735854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
15752024-09-23T23:12:08.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 857.057173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
15762024-09-23T23:12:08.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 1.442739824s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
15772024-09-23T23:12:08.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 1.347646957s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
15782024-09-23T23:12:08.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 727.415283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
15792024-09-23T23:12:08.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 1.454213229s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
15802024-09-23T23:12:08.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 985.184838ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
15812024-09-23T23:12:08.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 932.755486ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
15822024-09-23T23:12:08.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 796.17448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
15832024-09-23T23:12:08.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.022118786s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
15842024-09-23T23:12:08.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.050652433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
15852024-09-23T23:12:08.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 977.867776ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
15862024-09-23T23:12:09.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 630.883751ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
15872024-09-23T23:12:09.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.303384776s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
15882024-09-23T23:12:09.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 648.616469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
15892024-09-23T23:12:09.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 1.093976666s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
15902024-09-23T23:12:09.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 1.231953756s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
15912024-09-23T23:12:09.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 951.852275ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
15922024-09-23T23:12:09.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.200830639s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
15932024-09-23T23:12:09.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 1.466383449s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
15942024-09-23T23:12:09.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.388701907s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
15952024-09-23T23:12:09.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 695.459652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
15962024-09-23T23:12:09.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 992.220144ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
15972024-09-23T23:12:09.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 739.090685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
15982024-09-23T23:12:09.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 1.032880456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
15992024-09-23T23:12:09.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.288599686s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
16002024-09-23T23:12:09.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 843.504189ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
16012024-09-23T23:12:09.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.021821697s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
16022024-09-23T23:12:09.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 892.10717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
16032024-09-23T23:12:09.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.235196906s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
16042024-09-23T23:12:10.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 624.558903ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
16052024-09-23T23:12:10.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 766.991484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
16062024-09-23T23:12:10.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 1.24535316s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
16072024-09-23T23:12:10.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 1.075849845s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
16082024-09-23T23:12:10.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 575.064196ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
16092024-09-23T23:12:10.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.070334448s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
16102024-09-23T23:12:10.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.251981189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
16112024-09-23T23:12:10.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 662.683519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
16122024-09-23T23:12:10.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 1.213770038s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
16132024-09-23T23:12:10.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 664.333171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
16142024-09-23T23:12:10.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 1.182560825s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
16152024-09-23T23:12:10.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.242938258s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
16162024-09-23T23:12:10.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 937.664977ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
16172024-09-23T23:12:10.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 572.121286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
16182024-09-23T23:12:10.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 1.091186735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
16192024-09-23T23:12:10.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 895.791343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
16202024-09-23T23:12:10.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.013066209s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
16212024-09-23T23:12:10.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 1.153051421s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
16222024-09-23T23:12:10.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.024519352s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
16232024-09-23T23:12:10.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 816.38494ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
16242024-09-23T23:12:11.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.4361896s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
16252024-09-23T23:12:11.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.081611778s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
16262024-09-23T23:12:11.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.102115044s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
16272024-09-23T23:12:11.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 556.51988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
16282024-09-23T23:12:11.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 856.770019ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
16292024-09-23T23:12:11.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 1.338858862s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
16302024-09-23T23:12:11.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 1.120183678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
16312024-09-23T23:12:11.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3") failed: Property not found. retry in 1.160145939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
16322024-09-23T23:12:11.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.409533677s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
16332024-09-23T23:12:11.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 897.328489ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
16342024-09-23T23:12:11.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 958.4129ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
16352024-09-23T23:12:11.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f") failed: Property not found. retry in 1.396622918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
16362024-09-23T23:12:11.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 841.636877ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
16372024-09-23T23:12:11.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 804.979589ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
16382024-09-23T23:12:11.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 691.125421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
16392024-09-23T23:12:11.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.132358637s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
16402024-09-23T23:12:11.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 512.317338ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
16412024-09-23T23:12:11.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 665.671898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
16422024-09-23T23:12:11.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.290950762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
16432024-09-23T23:12:12.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 933.537447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
16442024-09-23T23:12:12.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 765.894811ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
16452024-09-23T23:12:12.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6") failed: Property not found. retry in 1.223336634s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
16462024-09-23T23:12:12.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.068376933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
16472024-09-23T23:12:12.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.347706877s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
16482024-09-23T23:12:12.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.002804132s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
16492024-09-23T23:12:12.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1") failed: Property not found. retry in 1.323381408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
16502024-09-23T23:12:12.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 950.569884ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
16512024-09-23T23:12:12.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 1.135469301s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
16522024-09-23T23:12:12.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 1.092762423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
16532024-09-23T23:12:12.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 825.657574ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
16542024-09-23T23:12:12.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 552.787318ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
16552024-09-23T23:12:12.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 1.192636783s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
16562024-09-23T23:12:12.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 640.789629ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
16572024-09-23T23:12:12.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 603.147033ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
16582024-09-23T23:12:13.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 1.109103323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
16592024-09-23T23:12:13.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 1.000086641s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
16602024-09-23T23:12:13.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 853.343652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
16612024-09-23T23:12:13.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 946.237494ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
16622024-09-23T23:12:13.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 564.582181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
16632024-09-23T23:12:13.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 819.661882ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
16642024-09-23T23:12:13.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 951.479305ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
16652024-09-23T23:12:13.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 1.035454643s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
16662024-09-23T23:12:13.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 971.818848ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
16672024-09-23T23:12:13.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 643.850715ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
16682024-09-23T23:12:13.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 1.243335609s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
16692024-09-23T23:12:13.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f") failed: Property not found. retry in 981.583969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
16702024-09-23T23:12:13.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 535.711702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
16712024-09-23T23:12:13.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 744.099444ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
16722024-09-23T23:12:13.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.224798729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
16732024-09-23T23:12:13.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 516.880431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
16742024-09-23T23:12:13.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 819.439685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
16752024-09-23T23:12:14.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 634.898009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
16762024-09-23T23:12:14.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 652.184714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
16772024-09-23T23:12:14.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 729.521953ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
16782024-09-23T23:12:14.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 634.528641ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
16792024-09-23T23:12:14.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8") failed: Property not found. retry in 1.247154468s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
16802024-09-23T23:12:14.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978") failed: Property not found. retry in 843.79502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
16812024-09-23T23:12:14.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80") failed: Property not found. retry in 1.404008287s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
16822024-09-23T23:12:14.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 898.427544ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
16832024-09-23T23:12:14.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 778.808902ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
16842024-09-23T23:12:14.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c") failed: Property not found. retry in 1.320711633s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
16852024-09-23T23:12:14.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda") failed: Property not found. retry in 1.338406472s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
16862024-09-23T23:12:14.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e") failed: Property not found. retry in 948.859304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
16872024-09-23T23:12:14.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 1.201520766s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
16882024-09-23T23:12:14.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d") failed: Property not found. retry in 1.141663446s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
16892024-09-23T23:12:14.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 785.937852ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
16902024-09-23T23:12:14.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b") failed: Property not found. retry in 1.371480466s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
16912024-09-23T23:12:14.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d") failed: Property not found. retry in 727.915699ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
16922024-09-23T23:12:15.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0") failed: Property not found. retry in 1.436499462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
16932024-09-23T23:12:15.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 573.563251ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
16942024-09-23T23:12:15.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83") failed: Property not found. retry in 834.837182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
16952024-09-23T23:12:15.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63") failed: Property not found. retry in 1.206785464s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
16962024-09-23T23:12:15.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474") failed: Property not found. retry in 1.301473555s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
16972024-09-23T23:12:16.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035") failed: Property not found. retry in 730.539812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
16982024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_nexus_8edf7e0a-db5e-4594-b36b-7d389db56474
16992024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_external_dns_e3d8dede-8980-4764-ac40-c508c2ebab6c
17002024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_nexus_212442ce-6712-4c6a-beb4-26917e04679b
17012024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_nexus_b905b025-1e4a-4a11-bf0c-620257156cd8
17022024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_c862f8c9-0ecd-45c2-b556-070743c225b6
17032024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_bf16b0f2-13a2-49a5-9700-bbce43d9c5d0
17042024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_ec6e51cd-fb03-46ba-babc-4aa3fc3244c1
17052024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_pantry_d04d138d-f307-4152-86f9-2f578b958978
17062024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_46ddf6ac-e0eb-4eed-ade3-abef88f1df83
17072024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_c08193c1-677d-424a-b7e3-47f8ed6c514f
17082024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_3c7fbc67-6915-4dfd-a158-b9ff8dbf6b80
17092024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_oximeter_b1b00c55-180a-49a6-8247-29e381ecf42d
17102024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_pantry_aa88cf81-d727-4e19-bd63-38f1fc37cdd3
17112024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_63847a61-061a-4155-84f8-b066c5b4e035
17122024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_2021e4db-ac4e-4c53-aefe-4b4a4cee329f
17132024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_clickhouse_3b14b4d1-4fc7-4f24-8b3f-24303b8d8c63
17142024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_external_dns_954a3d10-a2dd-433b-9252-ede695863bda
17152024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_pantry_7300ee9b-dcec-4cd9-afee-4935a43e803d
17162024-09-23T23:12:17.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3279 zone = oxz_crucible_3a08792a-4a03-479c-8556-d27ce039902e
17172024-09-23T23:12:17.281ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17182024-09-23T23:12:17.283ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17192024-09-23T23:12:17.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 45267044 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64903 req_id = 36f6afe5-1639-4e05-8ac2-db622e27f4e8 response_code = 204 uri = /omicron-zones
17202024-09-23T23:12:17.291ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1322
17212024-09-23T23:12:17.292ZINFOSledAgent (RSS): Writing ledger to /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17222024-09-23T23:12:17.292ZINFOSledAgent (RSS): Writing ledger to /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17232024-09-23T23:12:17.296ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:707
17242024-09-23T23:12:17.303ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:720
17252024-09-23T23:12:17.344ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), local_pref: None, nexthop: 10.151.2.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:887
17262024-09-23T23:12:17.349ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17272024-09-23T23:12:17.491ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17282024-09-23T23:12:17.657ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17292024-09-23T23:12:17.871ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17302024-09-23T23:12:17.961ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17312024-09-23T23:12:18.259ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17322024-09-23T23:12:18.624ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17332024-09-23T23:12:18.790ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17342024-09-23T23:12:19.082ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17352024-09-23T23:12:19.599ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17362024-09-23T23:12:20.267ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17372024-09-23T23:12:20.701ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17382024-09-23T23:12:21.132ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17392024-09-23T23:12:22.419ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17402024-09-23T23:12:23.010ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17412024-09-23T23:12:23.974ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 47.239098837s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17422024-09-23T23:12:24.438ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17432024-09-23T23:12:26.243ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17442024-09-23T23:12:26.983ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17452024-09-23T23:12:27.122ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17462024-09-23T23:12:27.348ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17472024-09-23T23:12:28.593ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17482024-09-23T23:12:28.892ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17492024-09-23T23:12:29.119ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17502024-09-23T23:12:29.597ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17512024-09-23T23:12:30.601ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17522024-09-23T23:12:31.120ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17532024-09-23T23:12:31.184ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17542024-09-23T23:12:31.605ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17552024-09-23T23:12:32.608ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17562024-09-23T23:12:33.119ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17572024-09-23T23:12:33.611ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17582024-09-23T23:12:33.748ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/20416e3d-a221-481f-9784-cbbcea3a72c8/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
17592024-09-23T23:12:34.614ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17602024-09-23T23:12:35.120ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:571 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17612024-09-23T23:12:35.617ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:230 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17622024-09-23T23:12:37.335ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44815
17632024-09-23T23:12:37.336ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 545 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44815 req_id = cd57b278-c321-48b3-b239-5c897a9fad7a response_code = 200 uri = /baseboard
17642024-09-23T23:12:39.140ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:544 new_generation = 1 old_generation = 1 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
17652024-09-23T23:12:39.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49665
17662024-09-23T23:12:39.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
17672024-09-23T23:12:39.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 188645 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49665 req_id = 38378bf3-ec21-415d-b947-4b2a3f6f0a6c response_code = 200 uri = /inventory
17682024-09-23T23:12:39.422ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
17692024-09-23T23:12:39.422ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/omicron-zones.json file = common/src/ledger.rs:177
17702024-09-23T23:12:39.422ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/omicron-zones.json file = common/src/ledger.rs:177
17712024-09-23T23:12:39.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1568 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49665 req_id = c081cb3a-cdf0-42f0-9ed7-daca09faf73b response_code = 200 uri = /omicron-zones
17722024-09-23T23:12:40.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54637
17732024-09-23T23:12:40.553ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 074197bc-2b3f-4fe9-94c0-14608c5dfec9, kind: Service { id: 954a3d10-a2dd-433b-9252-ede695863bda }, name: Name("external-dns-954a3d10-a2dd-433b-9252-ede695863bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3ab2617-5a99-4fbe-a7d1-4d5673064c67, kind: Service { id: e3d8dede-8980-4764-ac40-c508c2ebab6c }, name: Name("external-dns-e3d8dede-8980-4764-ac40-c508c2ebab6c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 212])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12e743bf-60f7-4d25-9b2b-595ff259882d, kind: Service { id: 8edf7e0a-db5e-4594-b36b-7d389db56474 }, name: Name("nexus-8edf7e0a-db5e-4594-b36b-7d389db56474"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ad747b06-b112-4f84-a56c-95e2ad7cc8d4, kind: Service { id: 212442ce-6712-4c6a-beb4-26917e04679b }, name: Name("nexus-212442ce-6712-4c6a-beb4-26917e04679b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ebf272b6-074a-4cee-a95e-216e4da4a83b, kind: Service { id: b905b025-1e4a-4a11-bf0c-620257156cd8 }, name: Name("nexus-b905b025-1e4a-4a11-bf0c-620257156cd8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17742024-09-23T23:12:40.553ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17752024-09-23T23:12:40.553ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17762024-09-23T23:12:40.553ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17772024-09-23T23:12:40.553ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17782024-09-23T23:12:40.553ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
17792024-09-23T23:12:40.553ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17802024-09-23T23:12:40.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54637 req_id = 95d53470-7d11-4dec-8935-815da3b62739 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17812024-09-23T23:12:40.555ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:959
17822024-09-23T23:12:40.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44732
17832024-09-23T23:12:40.928ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 074197bc-2b3f-4fe9-94c0-14608c5dfec9, kind: Service { id: 954a3d10-a2dd-433b-9252-ede695863bda }, name: Name("external-dns-954a3d10-a2dd-433b-9252-ede695863bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3ab2617-5a99-4fbe-a7d1-4d5673064c67, kind: Service { id: e3d8dede-8980-4764-ac40-c508c2ebab6c }, name: Name("external-dns-e3d8dede-8980-4764-ac40-c508c2ebab6c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 212])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12e743bf-60f7-4d25-9b2b-595ff259882d, kind: Service { id: 8edf7e0a-db5e-4594-b36b-7d389db56474 }, name: Name("nexus-8edf7e0a-db5e-4594-b36b-7d389db56474"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ad747b06-b112-4f84-a56c-95e2ad7cc8d4, kind: Service { id: 212442ce-6712-4c6a-beb4-26917e04679b }, name: Name("nexus-212442ce-6712-4c6a-beb4-26917e04679b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ebf272b6-074a-4cee-a95e-216e4da4a83b, kind: Service { id: b905b025-1e4a-4a11-bf0c-620257156cd8 }, name: Name("nexus-b905b025-1e4a-4a11-bf0c-620257156cd8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17842024-09-23T23:12:40.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17852024-09-23T23:12:40.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17862024-09-23T23:12:40.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17872024-09-23T23:12:40.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17882024-09-23T23:12:40.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
17892024-09-23T23:12:40.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17902024-09-23T23:12:40.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44732 req_id = 770c0c80-9f4f-41cf-b873-7c6e2ecbab7f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17912024-09-23T23:12:40.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55969
17922024-09-23T23:12:40.931ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 074197bc-2b3f-4fe9-94c0-14608c5dfec9, kind: Service { id: 954a3d10-a2dd-433b-9252-ede695863bda }, name: Name("external-dns-954a3d10-a2dd-433b-9252-ede695863bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3ab2617-5a99-4fbe-a7d1-4d5673064c67, kind: Service { id: e3d8dede-8980-4764-ac40-c508c2ebab6c }, name: Name("external-dns-e3d8dede-8980-4764-ac40-c508c2ebab6c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 212])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12e743bf-60f7-4d25-9b2b-595ff259882d, kind: Service { id: 8edf7e0a-db5e-4594-b36b-7d389db56474 }, name: Name("nexus-8edf7e0a-db5e-4594-b36b-7d389db56474"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ad747b06-b112-4f84-a56c-95e2ad7cc8d4, kind: Service { id: 212442ce-6712-4c6a-beb4-26917e04679b }, name: Name("nexus-212442ce-6712-4c6a-beb4-26917e04679b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ebf272b6-074a-4cee-a95e-216e4da4a83b, kind: Service { id: b905b025-1e4a-4a11-bf0c-620257156cd8 }, name: Name("nexus-b905b025-1e4a-4a11-bf0c-620257156cd8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17932024-09-23T23:12:40.931ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17942024-09-23T23:12:40.932ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17952024-09-23T23:12:40.932ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17962024-09-23T23:12:40.932ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17972024-09-23T23:12:40.932ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
17982024-09-23T23:12:40.932ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17992024-09-23T23:12:40.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 854 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55969 req_id = 326e7e6f-dad5-4ba3-a93d-f90bd3ffe918 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18002024-09-23T23:12:40.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63860
18012024-09-23T23:12:40.941ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18022024-09-23T23:12:41.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 189212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63860 req_id = 5230cc18-e9b1-430c-b93c-ff740954e54d response_code = 200 uri = /inventory
18032024-09-23T23:12:41.131ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18042024-09-23T23:12:41.131ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/config/omicron-zones.json file = common/src/ledger.rs:177
18052024-09-23T23:12:41.131ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/config/omicron-zones.json file = common/src/ledger.rs:177
18062024-09-23T23:12:41.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 809 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63860 req_id = 382a7198-3719-4873-a7da-0908d41fa816 response_code = 200 uri = /omicron-zones
18072024-09-23T23:12:42.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33877
18082024-09-23T23:12:42.237ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 074197bc-2b3f-4fe9-94c0-14608c5dfec9, kind: Service { id: 954a3d10-a2dd-433b-9252-ede695863bda }, name: Name("external-dns-954a3d10-a2dd-433b-9252-ede695863bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3ab2617-5a99-4fbe-a7d1-4d5673064c67, kind: Service { id: e3d8dede-8980-4764-ac40-c508c2ebab6c }, name: Name("external-dns-e3d8dede-8980-4764-ac40-c508c2ebab6c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 212])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12e743bf-60f7-4d25-9b2b-595ff259882d, kind: Service { id: 8edf7e0a-db5e-4594-b36b-7d389db56474 }, name: Name("nexus-8edf7e0a-db5e-4594-b36b-7d389db56474"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ad747b06-b112-4f84-a56c-95e2ad7cc8d4, kind: Service { id: 212442ce-6712-4c6a-beb4-26917e04679b }, name: Name("nexus-212442ce-6712-4c6a-beb4-26917e04679b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ebf272b6-074a-4cee-a95e-216e4da4a83b, kind: Service { id: b905b025-1e4a-4a11-bf0c-620257156cd8 }, name: Name("nexus-b905b025-1e4a-4a11-bf0c-620257156cd8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18092024-09-23T23:12:42.237ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18102024-09-23T23:12:42.237ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18112024-09-23T23:12:42.237ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18122024-09-23T23:12:42.237ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18132024-09-23T23:12:42.237ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
18142024-09-23T23:12:42.237ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18152024-09-23T23:12:42.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 923 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33877 req_id = 1e9214b6-91ce-45c7-9267-801e0ae22a3c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18162024-09-23T23:12:46.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59071
18172024-09-23T23:12:46.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59071 req_id = a3f75a35-0cf5-41f4-aa3c-5938343aaa9c response_code = 200 uri = /vpc-routes
18182024-09-23T23:12:46.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1840 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59071 req_id = c334100c-8827-4e0e-904e-c39f8c0b19c6 response_code = 204 uri = /vpc-routes
18192024-09-23T23:13:07.374ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49895
18202024-09-23T23:13:07.374ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49895 req_id = b08d60f9-9ea5-4c02-9891-dc2559fccf11 response_code = 200 uri = /baseboard
18212024-09-23T23:13:07.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58183
18222024-09-23T23:13:07.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 821 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58183 req_id = 52b54755-2d9d-4a5a-83d3-05dd07f03286 response_code = 200 uri = /vpc-routes
18232024-09-23T23:13:07.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58183 req_id = 6dd423b5-664b-4c9d-88b9-29f4a4ac063b response_code = 204 uri = /vpc-routes
18242024-09-23T23:13:08.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50732
18252024-09-23T23:13:08.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 540 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50732 req_id = 0b3a4777-059f-46ac-b530-805f9a67393b response_code = 200 uri = /v2p
18262024-09-23T23:13:08.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38590
18272024-09-23T23:13:08.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38590 req_id = 0e010157-9476-40d9-96ad-e3f55a9199b2 response_code = 200 uri = /vpc-routes
18282024-09-23T23:13:08.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38590 req_id = f19e0f86-a2ac-494c-a37d-037185964a5d response_code = 204 uri = /vpc-routes
18292024-09-23T23:13:08.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62040
18302024-09-23T23:13:08.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62040 req_id = dcec77a4-d2b6-42ea-ae8f-671588849f9e response_code = 200 uri = /vpc-routes
18312024-09-23T23:13:08.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 802 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62040 req_id = 04c321fd-f4be-4c63-b821-6e6838209d90 response_code = 204 uri = /vpc-routes
18322024-09-23T23:13:08.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62956
18332024-09-23T23:13:08.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62956 req_id = 13db2fc0-32b7-437c-a1ec-0728538cfed7 response_code = 200 uri = /v2p
18342024-09-23T23:13:08.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54570
18352024-09-23T23:13:08.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 621 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54570 req_id = 6c86f5b8-b81a-472c-a3f6-a0b02270a0db response_code = 200 uri = /v2p
18362024-09-23T23:13:08.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36333
18372024-09-23T23:13:08.176ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
18382024-09-23T23:13:08.250ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
18392024-09-23T23:13:08.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 136090 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36333 req_id = aef80b9b-85fd-4c10-823e-61368a1e6be7 response_code = 204 uri = /switch-ports
18402024-09-23T23:13:08.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44925
18412024-09-23T23:13:08.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37747
18422024-09-23T23:13:08.311ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
18432024-09-23T23:13:08.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4679 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36333 req_id = 5432ca1b-9f7e-40ac-85cb-1114bda9e00b response_code = 200 uri = /network-bootstore-config
18442024-09-23T23:13:08.352ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
18452024-09-23T23:13:08.415ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
18462024-09-23T23:13:08.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103208 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44925 req_id = f8d5a7a2-24a7-4d3b-ab0a-263162b6d7d7 response_code = 204 uri = /switch-ports
18472024-09-23T23:13:08.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 653 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44925 req_id = 40d7f9b6-5328-4bac-98e2-e4432b10d212 response_code = 200 uri = /network-bootstore-config
18482024-09-23T23:13:08.441ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18492024-09-23T23:13:08.442ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18502024-09-23T23:13:08.443ZINFOSledAgent (bootstore): Writing ledger to /pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18512024-09-23T23:13:08.444ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18522024-09-23T23:13:08.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44925 req_id = 84bbbf63-ba13-4482-80ce-c7a77fb2af3d response_code = 204 uri = /network-bootstore-config
18532024-09-23T23:13:08.451ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
18542024-09-23T23:13:08.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 193854 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37747 req_id = 70151923-9fdc-487c-a3ed-b698ef9b53a1 response_code = 204 uri = /switch-ports
18552024-09-23T23:13:08.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37747 req_id = 5d2d01e0-bc44-40dd-8763-9bd33f458da2 response_code = 200 uri = /network-bootstore-config
18562024-09-23T23:13:37.408ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54815
18572024-09-23T23:13:37.409ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54815 req_id = 0fe8349e-e6be-4efe-9899-1a5dcec91edd response_code = 200 uri = /baseboard
18582024-09-23T23:13:38.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54850
18592024-09-23T23:13:38.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54850 req_id = 9be0c895-f275-402f-ae6e-bf38241e06fb response_code = 200 uri = /v2p
18602024-09-23T23:13:38.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64184
18612024-09-23T23:13:38.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64184 req_id = 44dd0468-f6d9-4b7f-89e7-ce9025c1f670 response_code = 200 uri = /vpc-routes
18622024-09-23T23:13:38.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64184 req_id = 5ca155cf-44b5-40d8-af70-17125c5cb8f3 response_code = 204 uri = /vpc-routes
18632024-09-23T23:13:38.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52973
18642024-09-23T23:13:38.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
18652024-09-23T23:13:38.231ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
18662024-09-23T23:13:38.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100441 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52973 req_id = dd4a31d9-fb0b-4714-b44c-6895176654ec response_code = 204 uri = /switch-ports
18672024-09-23T23:13:38.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35289
18682024-09-23T23:13:38.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61734
18692024-09-23T23:13:38.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35289 req_id = 3d49bda1-78e0-4167-87e8-116e72b41c24 response_code = 200 uri = /vpc-routes
18702024-09-23T23:13:38.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61734 req_id = ce1ec53a-0ca5-418a-9f3f-44c8fa4774e2 response_code = 200 uri = /vpc-routes
18712024-09-23T23:13:38.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52973 req_id = 84b58e0d-be00-4b1d-84af-101de09c0f2c response_code = 200 uri = /network-bootstore-config
18722024-09-23T23:13:38.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1002 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61734 req_id = cde763ef-b16e-49ae-9d8f-59b000ffa1d1 response_code = 204 uri = /vpc-routes
18732024-09-23T23:13:38.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35289 req_id = 80fa60aa-0cd2-45e0-a2e8-c6d15986f8b2 response_code = 204 uri = /vpc-routes
18742024-09-23T23:13:38.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59304
18752024-09-23T23:13:38.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59304 req_id = 9cff51d5-c5fc-4416-9d65-a82550fcdde2 response_code = 200 uri = /v2p
18762024-09-23T23:13:38.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64069
18772024-09-23T23:13:38.378ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
18782024-09-23T23:13:38.414ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
18792024-09-23T23:13:38.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92430 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64069 req_id = 9c978fa9-2d9c-457b-8ff2-71a9bc057129 response_code = 204 uri = /switch-ports
18802024-09-23T23:13:38.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51455
18812024-09-23T23:13:38.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51455 req_id = ad6f000a-0c2f-4f1d-8497-6109f151bc1b response_code = 200 uri = /v2p
18822024-09-23T23:13:38.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64069 req_id = 05f3e1ff-c95b-456a-ac48-31c8da4636e4 response_code = 200 uri = /network-bootstore-config
18832024-09-23T23:13:38.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60267
18842024-09-23T23:13:38.508ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
18852024-09-23T23:13:38.543ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
18862024-09-23T23:13:38.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92292 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60267 req_id = 03e3405b-ea95-4dd5-a132-a1850b25d977 response_code = 204 uri = /switch-ports
18872024-09-23T23:13:38.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60267 req_id = 0848d879-a218-4a84-99ea-e3bd1d9429e7 response_code = 200 uri = /network-bootstore-config
18882024-09-23T23:13:41.353ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:55701 remote_addr = [fd00:1122:3344:101::d]:42658 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
18892024-09-23T23:13:41.382ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 28244 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = 866a9008-a1a5-491f-adc9-61b727c57877 response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
18902024-09-23T23:14:02.040ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18912024-09-23T23:14:07.445ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60413
18922024-09-23T23:14:07.445ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 543 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60413 req_id = 946e0732-3ed9-44e2-91e7-0d963859c139 response_code = 200 uri = /baseboard
18932024-09-23T23:14:07.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53644
18942024-09-23T23:14:07.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53644 req_id = fed2dcf8-0a82-43f6-a9cf-c8129d7388e8 response_code = 200 uri = /vpc-routes
18952024-09-23T23:14:07.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38313
18962024-09-23T23:14:07.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38313 req_id = 94ff4a9a-eef2-484b-bf60-bec7ed50cfa0 response_code = 200 uri = /v2p
18972024-09-23T23:14:07.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53644 req_id = 67d367d3-7b10-4b66-9a8f-356eb839973e response_code = 204 uri = /vpc-routes
18982024-09-23T23:14:08.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42851
18992024-09-23T23:14:08.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42851 req_id = 5dc2128f-2efa-4cec-a6f7-d66ebc06f037 response_code = 200 uri = /vpc-routes
19002024-09-23T23:14:08.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58010
19012024-09-23T23:14:08.025ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
19022024-09-23T23:14:08.066ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
19032024-09-23T23:14:08.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103650 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58010 req_id = f5034af1-04f2-4ae5-8a9f-71c29a99fb1b response_code = 204 uri = /switch-ports
19042024-09-23T23:14:08.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56016
19052024-09-23T23:14:08.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52225
19062024-09-23T23:14:08.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42851 req_id = aa186f52-6b4c-4bbc-9a10-61d7c95131bd response_code = 204 uri = /vpc-routes
19072024-09-23T23:14:08.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58010 req_id = 80f997a5-3b9c-41cf-bd2e-5b6ba5d5a93f response_code = 200 uri = /network-bootstore-config
19082024-09-23T23:14:08.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52225 req_id = 3dc541f9-e673-4815-8535-f794ba130083 response_code = 200 uri = /vpc-routes
19092024-09-23T23:14:08.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56016 req_id = 02831c3a-fdc3-4ce0-8b3e-d066da2be979 response_code = 200 uri = /v2p
19102024-09-23T23:14:08.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52225 req_id = 9312b48e-44f7-42bc-9a83-eb7491e517d1 response_code = 204 uri = /vpc-routes
19112024-09-23T23:14:08.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35616
19122024-09-23T23:14:08.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35616 req_id = 012e6fb4-6b0e-4eb8-b917-57367183b4e5 response_code = 200 uri = /v2p
19132024-09-23T23:14:08.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37860
19142024-09-23T23:14:08.275ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
19152024-09-23T23:14:08.314ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
19162024-09-23T23:14:08.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37860 req_id = 26f12a81-bb19-4258-adf8-00a420f81f27 response_code = 204 uri = /switch-ports
19172024-09-23T23:14:08.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37860 req_id = c5382991-8743-4d19-bc79-878a075980cc response_code = 200 uri = /network-bootstore-config
19182024-09-23T23:14:08.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62814
19192024-09-23T23:14:08.384ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
19202024-09-23T23:14:08.421ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
19212024-09-23T23:14:08.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96817 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62814 req_id = f71895ae-5f01-4b6f-9570-dbd62de7df5d response_code = 204 uri = /switch-ports
19222024-09-23T23:14:08.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62814 req_id = 793fd9bc-4dff-428d-b301-35919fa04f67 response_code = 200 uri = /network-bootstore-config
19232024-09-23T23:14:11.362ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8701 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = 8a317eaa-b43a-49bf-b15b-09b8f595b232 response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
19242024-09-23T23:14:37.496ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49484
19252024-09-23T23:14:37.496ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49484 req_id = f22be2b2-f13d-481b-ac78-912fac1bb351 response_code = 200 uri = /baseboard
19262024-09-23T23:14:37.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46622
19272024-09-23T23:14:37.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1480 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46622 req_id = 7d0517e8-7f9a-4771-a0fa-d4cf715e38c9 response_code = 200 uri = /vpc-routes
19282024-09-23T23:14:37.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46622 req_id = 593b0569-b784-4de8-b0ba-bc9f06e8594a response_code = 204 uri = /vpc-routes
19292024-09-23T23:14:38.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45965
19302024-09-23T23:14:38.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45965 req_id = 549bd56a-3d8a-45be-8f39-99fe1e97fdec response_code = 200 uri = /v2p
19312024-09-23T23:14:38.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42112
19322024-09-23T23:14:38.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42112 req_id = b16184e7-3187-4fa3-9ea5-620732b952c2 response_code = 200 uri = /vpc-routes
19332024-09-23T23:14:38.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65261
19342024-09-23T23:14:38.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1015 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65261 req_id = 6afe6aba-b9c9-454d-bdf1-d851c476db26 response_code = 200 uri = /v2p
19352024-09-23T23:14:38.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52735
19362024-09-23T23:14:38.364ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
19372024-09-23T23:14:38.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
19382024-09-23T23:14:38.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93583 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52735 req_id = 2a1ccf7f-fe4e-411b-8b65-ac8c5a042e2f response_code = 204 uri = /switch-ports
19392024-09-23T23:14:38.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39999
19402024-09-23T23:14:38.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42112 req_id = 42f9e505-2736-4bde-989b-d4607de8acff response_code = 204 uri = /vpc-routes
19412024-09-23T23:14:38.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53411
19422024-09-23T23:14:38.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52735 req_id = 12e0cf16-2eca-444d-bf4d-32f4094b65b3 response_code = 200 uri = /network-bootstore-config
19432024-09-23T23:14:38.459ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
19442024-09-23T23:14:38.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53411 req_id = 2f1e15e0-67a3-42f5-8aa9-6535bd0fd593 response_code = 200 uri = /vpc-routes
19452024-09-23T23:14:38.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53411 req_id = 5307d0fc-936a-4e0f-bcd2-8b9e76684869 response_code = 204 uri = /vpc-routes
19462024-09-23T23:14:38.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56695
19472024-09-23T23:14:38.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56695 req_id = e6f6884b-c913-4dbc-9d86-78a45a22d2de response_code = 200 uri = /v2p
19482024-09-23T23:14:38.498ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
19492024-09-23T23:14:38.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51385
19502024-09-23T23:14:38.560ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
19512024-09-23T23:14:38.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101235 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39999 req_id = 0484ea2c-6db5-4104-98ac-31c9b41a1f6d response_code = 204 uri = /switch-ports
19522024-09-23T23:14:38.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 598 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39999 req_id = 00325e8f-3147-488a-b864-e1e09505d2d7 response_code = 200 uri = /network-bootstore-config
19532024-09-23T23:14:38.596ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
19542024-09-23T23:14:38.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 124601 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51385 req_id = 31513ea2-e5d4-424f-9567-313673c7b2df response_code = 204 uri = /switch-ports
19552024-09-23T23:14:38.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51385 req_id = 6e4ad52a-e757-40c2-be4a-fee32433b9b7 response_code = 200 uri = /network-bootstore-config
19562024-09-23T23:14:41.360ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6888 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = efbc5afb-d5a2-4c8d-b0a8-0e94e40548ba response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
19572024-09-23T23:15:07.531ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56777
19582024-09-23T23:15:07.531ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56777 req_id = d34f39dd-bdd5-4b08-a7d2-10cb3efeeebb response_code = 200 uri = /baseboard
19592024-09-23T23:15:07.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39524
19602024-09-23T23:15:07.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39524 req_id = e3e048b8-d72a-4a12-a922-63f6147668e8 response_code = 200 uri = /vpc-routes
19612024-09-23T23:15:07.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39524 req_id = 2b91b6e6-b510-4dae-a402-f6280abbc02d response_code = 204 uri = /vpc-routes
19622024-09-23T23:15:07.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36991
19632024-09-23T23:15:07.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36991 req_id = bdeede75-871d-4233-ad19-a2701223017d response_code = 200 uri = /v2p
19642024-09-23T23:15:07.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32817
19652024-09-23T23:15:07.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32817 req_id = 6e684d58-1c97-4e2e-af41-6aad5a8537f9 response_code = 200 uri = /vpc-routes
19662024-09-23T23:15:07.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32817 req_id = 87b39f31-cefb-4e5e-ae24-3f3a9cddcb10 response_code = 204 uri = /vpc-routes
19672024-09-23T23:15:08.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57370
19682024-09-23T23:15:08.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57370 req_id = 28d2bc56-5ae0-402a-8445-e570ef14f833 response_code = 200 uri = /v2p
19692024-09-23T23:15:08.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41018
19702024-09-23T23:15:08.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41018 req_id = d5307b10-1475-4090-971d-4ce447e0ccb1 response_code = 200 uri = /vpc-routes
19712024-09-23T23:15:08.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41018 req_id = 46e46364-c8a3-4d24-a298-7c4be83d9cf2 response_code = 204 uri = /vpc-routes
19722024-09-23T23:15:08.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61841
19732024-09-23T23:15:08.248ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
19742024-09-23T23:15:08.287ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
19752024-09-23T23:15:08.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96559 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61841 req_id = 771648c3-040a-4689-9c55-b509f77e746e response_code = 204 uri = /switch-ports
19762024-09-23T23:15:08.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45783
19772024-09-23T23:15:08.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55102
19782024-09-23T23:15:08.345ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
19792024-09-23T23:15:08.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 896 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45783 req_id = 6d7b824c-e1ad-4424-a228-9f0fc0d30ca7 response_code = 200 uri = /v2p
19802024-09-23T23:15:08.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4094 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61841 req_id = 02da9052-ba69-43fc-bce5-9cf89e7b0b68 response_code = 200 uri = /network-bootstore-config
19812024-09-23T23:15:08.375ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
19822024-09-23T23:15:08.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 83054 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55102 req_id = 2edab997-939e-4f0c-b141-846de92f099e response_code = 204 uri = /switch-ports
19832024-09-23T23:15:08.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55102 req_id = 17de8418-164a-48b8-ad9f-5f1db7f543da response_code = 200 uri = /network-bootstore-config
19842024-09-23T23:15:08.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36874
19852024-09-23T23:15:08.490ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
19862024-09-23T23:15:08.529ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
19872024-09-23T23:15:08.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100087 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36874 req_id = ed074320-d798-436f-94b2-939927293254 response_code = 204 uri = /switch-ports
19882024-09-23T23:15:08.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36874 req_id = 8f67e3a3-886e-4905-b6a4-6503d91eee9c response_code = 200 uri = /network-bootstore-config
19892024-09-23T23:15:11.362ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8991 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = 9e0a94c9-b9b3-401d-bf05-003802f71cdc response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
19902024-09-23T23:15:37.563ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40136
19912024-09-23T23:15:37.563ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40136 req_id = 94b19a2e-df01-4df5-952f-de194c616347 response_code = 200 uri = /baseboard
19922024-09-23T23:15:38.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51517
19932024-09-23T23:15:38.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 427 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51517 req_id = 33e5b893-03fe-4139-9bec-c8a93846da80 response_code = 200 uri = /vpc-routes
19942024-09-23T23:15:38.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51517 req_id = 222d8912-a377-41b3-bc0f-6464b219f4a9 response_code = 204 uri = /vpc-routes
19952024-09-23T23:15:38.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64227
19962024-09-23T23:15:38.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64227 req_id = 2180172d-3a7e-4b21-8f59-ebfc8437a5b0 response_code = 200 uri = /v2p
19972024-09-23T23:15:38.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58131
19982024-09-23T23:15:38.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58131 req_id = 040610bc-99ba-4a4c-8d49-a13827a20e43 response_code = 200 uri = /v2p
19992024-09-23T23:15:38.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64435
20002024-09-23T23:15:38.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64435 req_id = f50218b8-b153-41c8-9a4c-197a02e925a6 response_code = 200 uri = /vpc-routes
20012024-09-23T23:15:38.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64435 req_id = c850c4de-e5f3-4ed8-8604-9be693163732 response_code = 204 uri = /vpc-routes
20022024-09-23T23:15:38.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45943
20032024-09-23T23:15:38.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45943 req_id = 874d6366-00e0-4f72-a013-b7ccfcaa3852 response_code = 200 uri = /vpc-routes
20042024-09-23T23:15:38.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51725
20052024-09-23T23:15:38.389ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
20062024-09-23T23:15:38.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
20072024-09-23T23:15:38.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 116023 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51725 req_id = d02a0a87-bdd5-45dd-bc93-c38b5080d05e response_code = 204 uri = /switch-ports
20082024-09-23T23:15:38.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34203
20092024-09-23T23:15:38.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45943 req_id = c1192fd2-aca7-4bbf-b56b-8d146c3eb64e response_code = 204 uri = /vpc-routes
20102024-09-23T23:15:38.505ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
20112024-09-23T23:15:38.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51725 req_id = 6d0b10c5-c7e9-4e7a-bad4-c6555d7f305a response_code = 200 uri = /network-bootstore-config
20122024-09-23T23:15:38.546ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
20132024-09-23T23:15:38.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39243
20142024-09-23T23:15:38.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39243 req_id = 1b578fdf-7cc7-490c-a785-65cf2b4ed15a response_code = 200 uri = /v2p
20152024-09-23T23:15:38.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60981
20162024-09-23T23:15:38.607ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
20172024-09-23T23:15:38.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101743 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34203 req_id = 52bc05a3-29b8-42bd-a189-fbc6d4abbc8e response_code = 204 uri = /switch-ports
20182024-09-23T23:15:38.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 647 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34203 req_id = 55e6b388-f7ce-4749-8b26-91f5e84eed46 response_code = 200 uri = /network-bootstore-config
20192024-09-23T23:15:38.645ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
20202024-09-23T23:15:38.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 153701 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60981 req_id = 5898c173-9bab-4612-8547-e5eaf0dcaaaf response_code = 204 uri = /switch-ports
20212024-09-23T23:15:38.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 661 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60981 req_id = 70864980-bdff-4905-8403-b77f9c2725c9 response_code = 200 uri = /network-bootstore-config
20222024-09-23T23:15:41.368ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6386 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = 064aabea-798f-431d-97e0-b08ec17dde52 response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
20232024-09-23T23:16:07.595ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52453
20242024-09-23T23:16:07.596ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52453 req_id = 70d85ffc-2870-49af-aacd-0808f574802c response_code = 200 uri = /baseboard
20252024-09-23T23:16:07.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62739
20262024-09-23T23:16:07.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1802 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62739 req_id = 9aa34b40-bf43-43fe-a4e9-1f133c1842b1 response_code = 200 uri = /vpc-routes
20272024-09-23T23:16:07.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58655
20282024-09-23T23:16:07.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58655 req_id = 184a3004-89cc-4ee3-a209-56f6787ffc54 response_code = 200 uri = /v2p
20292024-09-23T23:16:07.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62739 req_id = 0bfc1097-6f71-4c6d-b518-99376fbbea03 response_code = 204 uri = /vpc-routes
20302024-09-23T23:16:08.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38400
20312024-09-23T23:16:08.009ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
20322024-09-23T23:16:08.056ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
20332024-09-23T23:16:08.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111600 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38400 req_id = 264717cd-478c-419d-ae18-f4d7000d1d09 response_code = 204 uri = /switch-ports
20342024-09-23T23:16:08.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64425
20352024-09-23T23:16:08.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33827
20362024-09-23T23:16:08.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64425 req_id = 00574c85-ef47-4dc6-a325-55f63e0d3478 response_code = 200 uri = /vpc-routes
20372024-09-23T23:16:08.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38400 req_id = 231a916b-5520-4ef4-b827-e9274c2f53aa response_code = 200 uri = /network-bootstore-config
20382024-09-23T23:16:08.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33827 req_id = 5c2e8632-a512-45ba-876a-5d8edf3152b8 response_code = 200 uri = /v2p
20392024-09-23T23:16:08.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64425 req_id = ce0fd010-15da-4722-98e4-cdbb74777740 response_code = 204 uri = /vpc-routes
20402024-09-23T23:16:08.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37356
20412024-09-23T23:16:08.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37356 req_id = b00e53e5-ab29-450e-b4d7-60f7f773055e response_code = 200 uri = /vpc-routes
20422024-09-23T23:16:08.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 707 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37356 req_id = cf31cb0f-2513-4744-9bf4-4ede3cdaa0fa response_code = 204 uri = /vpc-routes
20432024-09-23T23:16:08.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64897
20442024-09-23T23:16:08.316ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
20452024-09-23T23:16:08.354ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
20462024-09-23T23:16:08.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95539 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64897 req_id = 3a5938c5-0865-49d5-82da-897dff7de3c2 response_code = 204 uri = /switch-ports
20472024-09-23T23:16:08.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58775
20482024-09-23T23:16:08.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58775 req_id = a4a634d2-8be4-43de-9d67-3d224bee0a58 response_code = 200 uri = /v2p
20492024-09-23T23:16:08.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 915 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64897 req_id = f97e468d-39aa-4011-88cd-dc394b0fff65 response_code = 200 uri = /network-bootstore-config
20502024-09-23T23:16:08.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38573
20512024-09-23T23:16:08.503ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
20522024-09-23T23:16:08.540ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
20532024-09-23T23:16:08.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97064 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38573 req_id = 1fc75c49-11f4-44ad-ab77-49f970b13b1d response_code = 204 uri = /switch-ports
20542024-09-23T23:16:08.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38573 req_id = 2829461e-8a17-4b94-8bb2-34738d6a4374 response_code = 200 uri = /network-bootstore-config
20552024-09-23T23:16:11.439ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7142 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = 2bdfc250-ff41-40cc-9209-0bda044c028d response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
20562024-09-23T23:16:37.634ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65351
20572024-09-23T23:16:37.637ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65351 req_id = 6824050f-2b6d-44f0-9d24-6ddafe8dbee7 response_code = 200 uri = /baseboard
20582024-09-23T23:16:37.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60676
20592024-09-23T23:16:37.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1413 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60676 req_id = bd113771-b2d7-4f04-b484-d180b2c9fea8 response_code = 200 uri = /vpc-routes
20602024-09-23T23:16:38.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60676 req_id = c5b016e3-391c-488a-9e02-c5261fb2bf47 response_code = 204 uri = /vpc-routes
20612024-09-23T23:16:38.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40959
20622024-09-23T23:16:38.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1014 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40959 req_id = 2a01bc11-0bab-403f-9c1e-f30b492ac085 response_code = 200 uri = /v2p
20632024-09-23T23:16:38.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35540
20642024-09-23T23:16:38.212ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
20652024-09-23T23:16:38.251ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
20662024-09-23T23:16:38.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103760 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35540 req_id = 63e8a107-10d2-4564-b15e-ed49ce867177 response_code = 204 uri = /switch-ports
20672024-09-23T23:16:38.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59836
20682024-09-23T23:16:38.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53064
20692024-09-23T23:16:38.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35540 req_id = 7aedd8c2-c5b2-4081-a645-7175048ea3e2 response_code = 200 uri = /network-bootstore-config
20702024-09-23T23:16:38.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1055 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59836 req_id = 42bb1717-4134-47b3-97c9-97548c93afdd response_code = 200 uri = /vpc-routes
20712024-09-23T23:16:38.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 998 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53064 req_id = 31ce93b0-f4db-4a93-81d7-ffa3ea868c90 response_code = 200 uri = /vpc-routes
20722024-09-23T23:16:38.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53064 req_id = d1a24285-1133-4d0f-9165-8efa2334da3d response_code = 204 uri = /vpc-routes
20732024-09-23T23:16:38.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59836 req_id = b3b887ea-5a59-43d3-9830-0e920844e484 response_code = 204 uri = /vpc-routes
20742024-09-23T23:16:38.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48350
20752024-09-23T23:16:38.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48350 req_id = a64aa9ba-29bb-436a-941e-4bbcaabae97e response_code = 200 uri = /v2p
20762024-09-23T23:16:38.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37182
20772024-09-23T23:16:38.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37182 req_id = 18383185-5cac-4f33-a395-b037162d29df response_code = 200 uri = /v2p
20782024-09-23T23:16:38.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48476
20792024-09-23T23:16:38.417ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
20802024-09-23T23:16:38.455ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
20812024-09-23T23:16:38.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94023 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48476 req_id = 64c0c205-2f40-4544-8be0-ee72f0da6fb5 response_code = 204 uri = /switch-ports
20822024-09-23T23:16:38.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47609
20832024-09-23T23:16:38.512ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
20842024-09-23T23:16:38.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1381 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48476 req_id = 7dbe90c3-dc94-4b97-942c-744f5c346761 response_code = 200 uri = /network-bootstore-config
20852024-09-23T23:16:38.548ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
20862024-09-23T23:16:38.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93195 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47609 req_id = 22332e43-e57d-48cd-819b-394873d24d74 response_code = 204 uri = /switch-ports
20872024-09-23T23:16:38.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47609 req_id = badb9893-9650-4207-9e44-fc0ea13964e9 response_code = 200 uri = /network-bootstore-config
20882024-09-23T23:16:41.439ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6727 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = e4bee466-f105-43b6-ad17-e1c6101eff55 response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
20892024-09-23T23:17:07.680ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59462
20902024-09-23T23:17:07.681ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59462 req_id = ba8d3bd1-81bd-4197-a83c-1736dc84fab9 response_code = 200 uri = /baseboard
20912024-09-23T23:17:07.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40065
20922024-09-23T23:17:07.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40065 req_id = c4de74f1-9acc-48fb-8340-f84d5363002d response_code = 200 uri = /vpc-routes
20932024-09-23T23:17:07.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40065 req_id = b682b3f7-ff16-409e-8b6e-5e0d84d329ee response_code = 204 uri = /vpc-routes
20942024-09-23T23:17:07.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49680
20952024-09-23T23:17:07.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49680 req_id = 155a5546-977d-4007-85b1-e44ac8309f76 response_code = 200 uri = /v2p
20962024-09-23T23:17:08.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59323
20972024-09-23T23:17:08.017ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
20982024-09-23T23:17:08.063ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
20992024-09-23T23:17:08.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111267 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59323 req_id = 73550318-41f3-493f-a896-a75e683dff3f response_code = 204 uri = /switch-ports
21002024-09-23T23:17:08.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54828
21012024-09-23T23:17:08.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51042
21022024-09-23T23:17:08.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 703 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54828 req_id = 3a955d38-94b9-4843-a600-6a8767465184 response_code = 200 uri = /vpc-routes
21032024-09-23T23:17:08.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 746 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59323 req_id = 0440cb5d-aaa0-4421-b5ef-534b25c47e48 response_code = 200 uri = /network-bootstore-config
21042024-09-23T23:17:08.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1789 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51042 req_id = 1010a699-67ce-485b-83d2-9df2afd1955f response_code = 200 uri = /vpc-routes
21052024-09-23T23:17:08.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54828 req_id = 32f92b3b-591b-44f5-94e7-bf0bf95cd406 response_code = 204 uri = /vpc-routes
21062024-09-23T23:17:08.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51042 req_id = 3753ec55-9205-427a-8e21-59b8fef14b81 response_code = 204 uri = /vpc-routes
21072024-09-23T23:17:08.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62326
21082024-09-23T23:17:08.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62326 req_id = ff0c4490-1952-488e-a527-a1070d53279f response_code = 200 uri = /v2p
21092024-09-23T23:17:08.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49439
21102024-09-23T23:17:08.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1045 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49439 req_id = 449c915e-588d-4e3f-a37d-00f0f4a9c32b response_code = 200 uri = /v2p
21112024-09-23T23:17:08.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51354
21122024-09-23T23:17:08.208ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
21132024-09-23T23:17:08.244ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
21142024-09-23T23:17:08.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98288 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51354 req_id = 7de8dc4a-0a2c-4661-9acf-cfeafc4c283e response_code = 204 uri = /switch-ports
21152024-09-23T23:17:08.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55695
21162024-09-23T23:17:08.306ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
21172024-09-23T23:17:08.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
21182024-09-23T23:17:08.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95456 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55695 req_id = f72a1908-6f87-47cd-a193-60367e373548 response_code = 204 uri = /switch-ports
21192024-09-23T23:17:08.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51354 req_id = 1f685455-f20f-4f00-a721-3b1c89baf3f7 response_code = 200 uri = /network-bootstore-config
21202024-09-23T23:17:08.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 781 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55695 req_id = b0c11dbb-d288-4cad-8977-7e7b858fe6c7 response_code = 200 uri = /network-bootstore-config
21212024-09-23T23:17:11.439ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6963 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = 4a4c3c52-8138-4111-b549-6224a0ba5403 response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
21222024-09-23T23:17:37.718ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39597
21232024-09-23T23:17:37.718ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 107 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39597 req_id = d57fb314-c6be-4c7b-9a53-9f37dafdb261 response_code = 200 uri = /baseboard
21242024-09-23T23:17:38.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45689
21252024-09-23T23:17:38.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45689 req_id = 5ef67907-33db-41ce-bb8c-02d6dac6d9ea response_code = 200 uri = /vpc-routes
21262024-09-23T23:17:38.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45689 req_id = f12e0cc2-5714-4d6a-9de4-c91eee4a2c81 response_code = 204 uri = /vpc-routes
21272024-09-23T23:17:38.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44041
21282024-09-23T23:17:38.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44041 req_id = 819b0648-94ca-4757-ad7f-d0fee3191b64 response_code = 200 uri = /vpc-routes
21292024-09-23T23:17:38.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44041 req_id = e9a3c8c9-5d5b-412e-bc67-0f6634635e7b response_code = 204 uri = /vpc-routes
21302024-09-23T23:17:38.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40416
21312024-09-23T23:17:38.143ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
21322024-09-23T23:17:38.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
21332024-09-23T23:17:38.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 128251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40416 req_id = 93d08345-ce03-48ea-8bf4-262631c82736 response_code = 204 uri = /switch-ports
21342024-09-23T23:17:38.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56886
21352024-09-23T23:17:38.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33648
21362024-09-23T23:17:38.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55074
21372024-09-23T23:17:38.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40416 req_id = 2611d947-6e30-4cdf-bdb7-4f2db9afa3a2 response_code = 200 uri = /network-bootstore-config
21382024-09-23T23:17:38.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56886 req_id = 195e5236-5fc9-4b8f-b18d-c3d0cfa21b56 response_code = 200 uri = /v2p
21392024-09-23T23:17:38.273ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 074197bc-2b3f-4fe9-94c0-14608c5dfec9, kind: Service { id: 954a3d10-a2dd-433b-9252-ede695863bda }, name: Name("external-dns-954a3d10-a2dd-433b-9252-ede695863bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3ab2617-5a99-4fbe-a7d1-4d5673064c67, kind: Service { id: e3d8dede-8980-4764-ac40-c508c2ebab6c }, name: Name("external-dns-e3d8dede-8980-4764-ac40-c508c2ebab6c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 212])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12e743bf-60f7-4d25-9b2b-595ff259882d, kind: Service { id: 8edf7e0a-db5e-4594-b36b-7d389db56474 }, name: Name("nexus-8edf7e0a-db5e-4594-b36b-7d389db56474"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ad747b06-b112-4f84-a56c-95e2ad7cc8d4, kind: Service { id: 212442ce-6712-4c6a-beb4-26917e04679b }, name: Name("nexus-212442ce-6712-4c6a-beb4-26917e04679b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ebf272b6-074a-4cee-a95e-216e4da4a83b, kind: Service { id: b905b025-1e4a-4a11-bf0c-620257156cd8 }, name: Name("nexus-b905b025-1e4a-4a11-bf0c-620257156cd8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21402024-09-23T23:17:38.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21412024-09-23T23:17:38.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21422024-09-23T23:17:38.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21432024-09-23T23:17:38.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21442024-09-23T23:17:38.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
21452024-09-23T23:17:38.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21462024-09-23T23:17:38.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 900 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33648 req_id = 9fd9f6ad-6db8-4dd1-b2eb-233f36e0f850 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21472024-09-23T23:17:38.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1761 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55074 req_id = 69cba39c-3113-4059-83a7-35a4e18a4514 response_code = 200 uri = /vpc-routes
21482024-09-23T23:17:38.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55074 req_id = e1cdf971-fe36-45e8-b505-ec09e883b3f0 response_code = 204 uri = /vpc-routes
21492024-09-23T23:17:38.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65300
21502024-09-23T23:17:38.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65300 req_id = b6022833-4d34-4cae-b11d-80d3db8776a4 response_code = 200 uri = /v2p
21512024-09-23T23:17:38.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46268
21522024-09-23T23:17:38.332ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
21532024-09-23T23:17:38.377ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
21542024-09-23T23:17:38.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 105043 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46268 req_id = c7161922-4c10-4c88-8c87-aa434bf4d1e3 response_code = 204 uri = /switch-ports
21552024-09-23T23:17:38.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43462
21562024-09-23T23:17:38.437ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 074197bc-2b3f-4fe9-94c0-14608c5dfec9, kind: Service { id: 954a3d10-a2dd-433b-9252-ede695863bda }, name: Name("external-dns-954a3d10-a2dd-433b-9252-ede695863bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3ab2617-5a99-4fbe-a7d1-4d5673064c67, kind: Service { id: e3d8dede-8980-4764-ac40-c508c2ebab6c }, name: Name("external-dns-e3d8dede-8980-4764-ac40-c508c2ebab6c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 212])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12e743bf-60f7-4d25-9b2b-595ff259882d, kind: Service { id: 8edf7e0a-db5e-4594-b36b-7d389db56474 }, name: Name("nexus-8edf7e0a-db5e-4594-b36b-7d389db56474"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ad747b06-b112-4f84-a56c-95e2ad7cc8d4, kind: Service { id: 212442ce-6712-4c6a-beb4-26917e04679b }, name: Name("nexus-212442ce-6712-4c6a-beb4-26917e04679b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ebf272b6-074a-4cee-a95e-216e4da4a83b, kind: Service { id: b905b025-1e4a-4a11-bf0c-620257156cd8 }, name: Name("nexus-b905b025-1e4a-4a11-bf0c-620257156cd8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21572024-09-23T23:17:38.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21582024-09-23T23:17:38.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21592024-09-23T23:17:38.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21602024-09-23T23:17:38.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21612024-09-23T23:17:38.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
21622024-09-23T23:17:38.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21632024-09-23T23:17:38.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43462 req_id = 22c5f676-9ef8-4451-aab4-d8c5ebd483b8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21642024-09-23T23:17:38.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 962 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46268 req_id = fe32b1fc-1119-424a-95bb-f720c91f0ddc response_code = 200 uri = /network-bootstore-config
21652024-09-23T23:17:38.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65102
21662024-09-23T23:17:38.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65102 req_id = 4ab4eabd-93cc-472c-9a44-b7f488dd97bb response_code = 200 uri = /v2p
21672024-09-23T23:17:38.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64967
21682024-09-23T23:17:38.577ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
21692024-09-23T23:17:38.617ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
21702024-09-23T23:17:38.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96426 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64967 req_id = d11e6bf0-d26e-438f-8335-8e0c26c61095 response_code = 204 uri = /switch-ports
21712024-09-23T23:17:38.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60302
21722024-09-23T23:17:38.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64967 req_id = 0e71a164-d9b9-46f1-9841-9e01b348823f response_code = 200 uri = /network-bootstore-config
21732024-09-23T23:17:38.674ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 074197bc-2b3f-4fe9-94c0-14608c5dfec9, kind: Service { id: 954a3d10-a2dd-433b-9252-ede695863bda }, name: Name("external-dns-954a3d10-a2dd-433b-9252-ede695863bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3ab2617-5a99-4fbe-a7d1-4d5673064c67, kind: Service { id: e3d8dede-8980-4764-ac40-c508c2ebab6c }, name: Name("external-dns-e3d8dede-8980-4764-ac40-c508c2ebab6c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 212])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12e743bf-60f7-4d25-9b2b-595ff259882d, kind: Service { id: 8edf7e0a-db5e-4594-b36b-7d389db56474 }, name: Name("nexus-8edf7e0a-db5e-4594-b36b-7d389db56474"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ad747b06-b112-4f84-a56c-95e2ad7cc8d4, kind: Service { id: 212442ce-6712-4c6a-beb4-26917e04679b }, name: Name("nexus-212442ce-6712-4c6a-beb4-26917e04679b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ebf272b6-074a-4cee-a95e-216e4da4a83b, kind: Service { id: b905b025-1e4a-4a11-bf0c-620257156cd8 }, name: Name("nexus-b905b025-1e4a-4a11-bf0c-620257156cd8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21742024-09-23T23:17:38.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21752024-09-23T23:17:38.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21762024-09-23T23:17:38.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21772024-09-23T23:17:38.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21782024-09-23T23:17:38.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
21792024-09-23T23:17:38.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21802024-09-23T23:17:38.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 461 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60302 req_id = 520e74cd-aaaa-420f-ae3e-bbe3d1ad3423 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21812024-09-23T23:17:41.440ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7645 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = 8618738f-5e4b-4fb1-957c-2d0e20113c4c response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
21822024-09-23T23:18:07.754ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58670
21832024-09-23T23:18:07.754ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58670 req_id = 940f6ecb-2673-4d30-8cd2-2d84c0d6ef56 response_code = 200 uri = /baseboard
21842024-09-23T23:18:07.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48719
21852024-09-23T23:18:07.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48719 req_id = dbbb5c9f-5a66-4a61-b37d-e8f73b548d9b response_code = 200 uri = /vpc-routes
21862024-09-23T23:18:07.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48719 req_id = f83ab3f7-32be-47df-9e3a-06f687244f80 response_code = 204 uri = /vpc-routes
21872024-09-23T23:18:07.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43740
21882024-09-23T23:18:07.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 752 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43740 req_id = 4459d7a4-f4f5-4c6a-8df6-5384459fe1ab response_code = 200 uri = /v2p
21892024-09-23T23:18:07.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42899
21902024-09-23T23:18:07.963ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
21912024-09-23T23:18:08.014ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
21922024-09-23T23:18:08.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 114679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42899 req_id = ba960779-bff3-4ba0-afa6-b1eaed191cd2 response_code = 204 uri = /switch-ports
21932024-09-23T23:18:08.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33000
21942024-09-23T23:18:08.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33000 req_id = afcbf30d-c99d-4f2d-8ca5-db24a3478098 response_code = 200 uri = /vpc-routes
21952024-09-23T23:18:08.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42899 req_id = 5a6be69c-e211-4e0a-8fbc-cd12c52dbdc8 response_code = 200 uri = /network-bootstore-config
21962024-09-23T23:18:08.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52560
21972024-09-23T23:18:08.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52560 req_id = 7ca77218-de0c-44fc-bf7c-72a34af28a41 response_code = 200 uri = /v2p
21982024-09-23T23:18:08.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33000 req_id = 9f2dc637-b578-486f-b9c7-61e9f6ef2583 response_code = 204 uri = /vpc-routes
21992024-09-23T23:18:08.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55274
22002024-09-23T23:18:08.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55274 req_id = 23d98b52-30f2-4791-9756-cd426be00d1a response_code = 200 uri = /vpc-routes
22012024-09-23T23:18:08.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 891 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55274 req_id = f4f63b36-2980-4a82-8e18-5cd6ad26ba24 response_code = 204 uri = /vpc-routes
22022024-09-23T23:18:08.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59412
22032024-09-23T23:18:08.287ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
22042024-09-23T23:18:08.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36710
22052024-09-23T23:18:08.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60770
22062024-09-23T23:18:08.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60770 req_id = 57d27c69-c960-44fc-940f-96d8dc88635c response_code = 200 uri = /v2p
22072024-09-23T23:18:08.329ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
22082024-09-23T23:18:08.384ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
22092024-09-23T23:18:08.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96410 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59412 req_id = d43eaffe-6546-4ca2-bcf5-b215303f1111 response_code = 204 uri = /switch-ports
22102024-09-23T23:18:08.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1043 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59412 req_id = 78bc5e9c-3c7f-4b95-ae72-cbd602812925 response_code = 200 uri = /network-bootstore-config
22112024-09-23T23:18:08.421ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
22122024-09-23T23:18:08.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 182264 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36710 req_id = eecbc8bd-f1a6-4f9a-8888-6c07c97937b7 response_code = 204 uri = /switch-ports
22132024-09-23T23:18:08.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 632 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36710 req_id = 410ba13a-eb30-435d-be81-047d13d0b6f4 response_code = 200 uri = /network-bootstore-config
22142024-09-23T23:18:11.439ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6794 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = d0fac2d4-fd9e-4648-8875-d436030a7601 response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
22152024-09-23T23:18:37.790ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64026
22162024-09-23T23:18:37.790ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64026 req_id = ae25e0c1-2def-4785-8fe5-c6ed9c94a118 response_code = 200 uri = /baseboard
22172024-09-23T23:18:38.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60214
22182024-09-23T23:18:38.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1642 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60214 req_id = 4ee94d7c-119d-424e-8b30-1856be06f5d5 response_code = 200 uri = /vpc-routes
22192024-09-23T23:18:38.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60214 req_id = a8b30d9f-4524-4b5c-b8e3-ea4532b7c275 response_code = 204 uri = /vpc-routes
22202024-09-23T23:18:38.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62610
22212024-09-23T23:18:38.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62610 req_id = 93343dd9-1a55-44f1-8324-85ea4eb9ed1d response_code = 200 uri = /vpc-routes
22222024-09-23T23:18:38.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62610 req_id = 6c98cace-833f-4932-99be-17304357473e response_code = 204 uri = /vpc-routes
22232024-09-23T23:18:38.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44362
22242024-09-23T23:18:38.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44362 req_id = 2add01d7-78ce-42d7-b1a3-a365f65028ff response_code = 200 uri = /vpc-routes
22252024-09-23T23:18:38.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35852
22262024-09-23T23:18:38.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35852 req_id = 1a537c5f-89ab-4979-b6c6-13d3d5611b58 response_code = 200 uri = /v2p
22272024-09-23T23:18:38.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44362 req_id = 0f2feb90-fe0a-4194-9de1-3b8605c34027 response_code = 204 uri = /vpc-routes
22282024-09-23T23:18:38.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38330
22292024-09-23T23:18:38.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1798 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38330 req_id = 4127ab68-43cc-4922-aaaf-5f9802eaa618 response_code = 200 uri = /v2p
22302024-09-23T23:18:38.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57211
22312024-09-23T23:18:38.282ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
22322024-09-23T23:18:38.322ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
22332024-09-23T23:18:38.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96819 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57211 req_id = e0b3077e-263f-4cee-bc61-5bfd4d6390fb response_code = 204 uri = /switch-ports
22342024-09-23T23:18:38.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33859
22352024-09-23T23:18:38.379ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
22362024-09-23T23:18:38.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57211 req_id = 18ce958b-8901-4368-8edf-92231812b416 response_code = 200 uri = /network-bootstore-config
22372024-09-23T23:18:38.417ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
22382024-09-23T23:18:38.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55554
22392024-09-23T23:18:38.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55554 req_id = 135ea8e0-951c-4569-81f3-52bdef98d475 response_code = 200 uri = /v2p
22402024-09-23T23:18:38.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92228 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33859 req_id = 8c753b41-3978-47d5-8e8b-bbcb50513630 response_code = 204 uri = /switch-ports
22412024-09-23T23:18:38.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 995 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33859 req_id = 471ca204-c9c0-4597-bf22-1eebaf70cc79 response_code = 200 uri = /network-bootstore-config
22422024-09-23T23:18:38.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36719
22432024-09-23T23:18:38.486ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
22442024-09-23T23:18:38.522ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
22452024-09-23T23:18:38.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93236 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36719 req_id = 5a868530-be9d-43e2-a12a-038169556182 response_code = 204 uri = /switch-ports
22462024-09-23T23:18:38.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36719 req_id = dce65a97-3c33-4f84-b684-424a7a3621f6 response_code = 200 uri = /network-bootstore-config
22472024-09-23T23:18:41.551ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8109 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = 28b3a410-d60b-4bc3-bca4-1a037893ea63 response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
22482024-09-23T23:18:46.856ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22492024-09-23T23:18:46.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
22502024-09-23T23:18:46.887ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1926, tv_nsec: 770929191 } time_to_next_cleanup = 599.99999558s
22512024-09-23T23:19:02.044ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22522024-09-23T23:19:07.835ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51227
22532024-09-23T23:19:07.837ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1503 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51227 req_id = a65bf818-02ba-46cf-bbbd-56cfb06e4255 response_code = 200 uri = /baseboard
22542024-09-23T23:19:07.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58969
22552024-09-23T23:19:07.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58969 req_id = 03d4c978-01bf-458f-a167-c902186edb2f response_code = 200 uri = /vpc-routes
22562024-09-23T23:19:08.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58541
22572024-09-23T23:19:08.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58541 req_id = 8dde81cd-333e-448d-a440-e2a6393c74e0 response_code = 200 uri = /vpc-routes
22582024-09-23T23:19:08.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53615
22592024-09-23T23:19:08.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53615 req_id = 71b2716a-4321-4c09-a22c-c1926e9c5c2b response_code = 200 uri = /v2p
22602024-09-23T23:19:08.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58969 req_id = 6fa6648a-ec01-4bd1-8260-31523155b0ba response_code = 204 uri = /vpc-routes
22612024-09-23T23:19:08.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54576
22622024-09-23T23:19:08.101ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
22632024-09-23T23:19:08.141ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
22642024-09-23T23:19:08.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 102164 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54576 req_id = bf3af4dc-c418-4706-8eac-41c27d2246e1 response_code = 204 uri = /switch-ports
22652024-09-23T23:19:08.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57229
22662024-09-23T23:19:08.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40177
22672024-09-23T23:19:08.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49451
22682024-09-23T23:19:08.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57229 req_id = 6f9a9ecb-f5ca-4139-b845-bc41bf38d7a7 response_code = 200 uri = /vpc-routes
22692024-09-23T23:19:08.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58541 req_id = 25acee3f-fa7d-4177-96db-95f9439be779 response_code = 204 uri = /vpc-routes
22702024-09-23T23:19:08.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 424 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54576 req_id = 55b8198e-4323-486a-a556-e206e3641e84 response_code = 200 uri = /network-bootstore-config
22712024-09-23T23:19:08.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49451 req_id = 974d2b55-333b-4cb4-b96a-7b389b0a3f98 response_code = 200 uri = /v2p
22722024-09-23T23:19:08.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 870 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40177 req_id = 5fdaee36-0b16-4074-babe-538ee264e98c response_code = 200 uri = /v2p
22732024-09-23T23:19:08.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57229 req_id = f52576b5-fe9c-4f6a-afee-07fe6d402cf6 response_code = 204 uri = /vpc-routes
22742024-09-23T23:19:08.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47383
22752024-09-23T23:19:08.252ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
22762024-09-23T23:19:08.293ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
22772024-09-23T23:19:08.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98608 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47383 req_id = c8439050-ac03-4eec-9d87-fd4d49b63d62 response_code = 204 uri = /switch-ports
22782024-09-23T23:19:08.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47021
22792024-09-23T23:19:08.351ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
22802024-09-23T23:19:08.387ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
22812024-09-23T23:19:08.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47021 req_id = 4003ecb8-e19e-4e3a-a847-895dbf5631a0 response_code = 204 uri = /switch-ports
22822024-09-23T23:19:08.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1033 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47021 req_id = afac1d56-a1e7-4621-8fd7-d49d51aba101 response_code = 200 uri = /network-bootstore-config
22832024-09-23T23:19:08.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1047 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47383 req_id = 97cef3f9-99eb-4180-bbb3-2828ec082810 response_code = 200 uri = /network-bootstore-config
22842024-09-23T23:19:11.551ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7329 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = f21e22ec-9655-4dd9-801f-1f99ac6206a9 response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
22852024-09-23T23:19:12.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61199
22862024-09-23T23:19:12.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61199 req_id = 77ff9987-f96c-4ef7-8ff3-7d1bfb258a9a response_code = 200 uri = /v2p
22872024-09-23T23:19:12.530ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:778 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(13450302) }
22882024-09-23T23:19:12.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61199 req_id = e0f10b67-79c3-4c30-98ad-0ddf7608cbff response_code = 204 uri = /v2p
22892024-09-23T23:19:12.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50000
22902024-09-23T23:19:12.705ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:539 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: f4bb8ae2-45f7-429f-99ec-b0f6c7cc3cd2, kind: Instance { id: cb582634-f7e6-465e-a57f-e77a51bf908d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13450302), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f4bb8ae2-45f7-429f-99ec-b0f6c7cc3cd2, kind: Instance { id: cb582634-f7e6-465e-a57f-e77a51bf908d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13450302), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f4bb8ae2-45f7-429f-99ec-b0f6c7cc3cd2, kind: Instance { id: cb582634-f7e6-465e-a57f-e77a51bf908d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13450302), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(13450302))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f4bb8ae2-45f7-429f-99ec-b0f6c7cc3cd2, kind: Instance { id: cb582634-f7e6-465e-a57f-e77a51bf908d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13450302), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-b1fb96cbd9f", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 541211d9-e5a5-486e-a8f9-4b7403d925ca, read_only_parent: Some(Volume { block_size: 512, id: 48b8240d-956e-4695-a7b4-86365ef3821d, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5ebd02f9-ecf7-40e4-b0f6-821eed7c7f1f, key: Some("PIINU4T9f/+1OE1hiBe4a4z+n1T8H04tNqNs92PX5bU="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 541211d9-e5a5-486e-a8f9-4b7403d925ca, key: Some("jKMKwsa/cD8OfW6JeKYLv6her2hcJEi1DTqMNBCw92M="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::12]:19000"] } }] } }], cloud_init_bytes: Some(..) } instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d metadata = InstanceMetadata { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, project_id: 09bf8117-7ca7-4472-a419-33af09f3ce6d } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-09-23T23:19:12.700219677Z }
22912024-09-23T23:19:12.705ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:572 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d migration_id = None propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
22922024-09-23T23:19:12.706ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1008 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d migration_id = None propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: f4bb8ae2-45f7-429f-99ec-b0f6c7cc3cd2, kind: Instance { id: cb582634-f7e6-465e-a57f-e77a51bf908d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13450302), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f4bb8ae2-45f7-429f-99ec-b0f6c7cc3cd2, kind: Instance { id: cb582634-f7e6-465e-a57f-e77a51bf908d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13450302), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f4bb8ae2-45f7-429f-99ec-b0f6c7cc3cd2, kind: Instance { id: cb582634-f7e6-465e-a57f-e77a51bf908d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13450302), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(13450302))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: f4bb8ae2-45f7-429f-99ec-b0f6c7cc3cd2, kind: Instance { id: cb582634-f7e6-465e-a57f-e77a51bf908d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13450302), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-b1fb96cbd9f", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 541211d9-e5a5-486e-a8f9-4b7403d925ca, read_only_parent: Some(Volume { block_size: 512, id: 48b8240d-956e-4695-a7b4-86365ef3821d, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5ebd02f9-ecf7-40e4-b0f6-821eed7c7f1f, key: Some("PIINU4T9f/+1OE1hiBe4a4z+n1T8H04tNqNs92PX5bU="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 541211d9-e5a5-486e-a8f9-4b7403d925ca, key: Some("jKMKwsa/cD8OfW6JeKYLv6her2hcJEi1DTqMNBCw92M="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::12]:19000"] } }] } }], cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-09-23T23:19:12.700219677Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
22932024-09-23T23:19:12.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7425 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50000 req_id = f10f3658-d831-469d-b70b-b8a45b8157ec response_code = 200 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
22942024-09-23T23:19:12.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48969
22952024-09-23T23:19:12.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48969 req_id = c549c32a-ce12-4b11-bacb-f79d037e0b12 response_code = 200 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878/state
22962024-09-23T23:19:12.825ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 13450302 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
22972024-09-23T23:19:12.825ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
22982024-09-23T23:19:12.869ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878 file = illumos-utils/src/zone.rs:316 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
22992024-09-23T23:19:12.894ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878 file = illumos-utils/src/zone.rs:354 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23002024-09-23T23:19:14.361ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23012024-09-23T23:19:14.362ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878 zone file = illumos-utils/src/running_zone.rs:488 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 zone = oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23022024-09-23T23:19:14.580ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878") failed: Property not found. retry in 62.250666ms file = illumos-utils/src/svc.rs:36 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 zone = oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23032024-09-23T23:19:14.656ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878") failed: Property not found. retry in 87.422742ms file = illumos-utils/src/svc.rs:36 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 zone = oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23042024-09-23T23:19:14.761ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878") failed: Property not found. retry in 102.015748ms file = illumos-utils/src/svc.rs:36 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 zone = oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23052024-09-23T23:19:14.884ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878") failed: Property not found. retry in 400.030255ms file = illumos-utils/src/svc.rs:36 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 zone = oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23062024-09-23T23:19:15.295ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878") failed: Property not found. retry in 632.460148ms file = illumos-utils/src/svc.rs:36 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 zone = oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23072024-09-23T23:19:15.942ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878") failed: Property not found. retry in 1.043788768s file = illumos-utils/src/svc.rs:36 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 zone = oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23082024-09-23T23:19:16.996ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878") failed: Property not found. retry in 1.426311961s file = illumos-utils/src/svc.rs:36 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 zone = oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23092024-09-23T23:19:18.433ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878") failed: Property not found. retry in 709.483532ms file = illumos-utils/src/svc.rs:36 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 zone = oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23102024-09-23T23:19:19.154ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878") failed: Property not found. retry in 1.426926147s file = illumos-utils/src/svc.rs:36 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 zone = oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23112024-09-23T23:19:20.610ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878 file = sled-agent/src/instance.rs:1466 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23122024-09-23T23:19:20.620ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1475 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23132024-09-23T23:19:20.657ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1499 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23142024-09-23T23:19:20.797ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:744 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23152024-09-23T23:19:20.798ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-09-23T23:19:20.798769742Z } file = sled-agent/src/instance.rs:594 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23162024-09-23T23:19:20.798ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-09-23T23:19:20.798769742Z } propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23172024-09-23T23:19:20.798ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-09-23T23:19:20.798769742Z }, migration_in: None, migration_out: None }
23182024-09-23T23:19:20.824ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-09-23T23:19:20.824906384Z } file = sled-agent/src/instance.rs:594 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23192024-09-23T23:19:20.824ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-23T23:19:20.824906384Z } propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23202024-09-23T23:19:20.824ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-23T23:19:20.824906384Z }, migration_in: None, migration_out: None }
23212024-09-23T23:19:37.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47461
23222024-09-23T23:19:37.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47461 req_id = d055482e-f117-4ae7-b612-f9984813c61a response_code = 200 uri = /vpc-routes
23232024-09-23T23:19:37.886ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51452
23242024-09-23T23:19:37.886ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51452 req_id = 6809464f-632e-41a5-a791-c73f2c73ad6e response_code = 200 uri = /baseboard
23252024-09-23T23:19:38.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33778
23262024-09-23T23:19:38.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33778 req_id = 45c8cbc1-5444-42dd-8a8b-5ca17f9ec2d6 response_code = 200 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878/state
23272024-09-23T23:19:38.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34718
23282024-09-23T23:19:38.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34718 req_id = 283f1c46-aec7-4183-853e-1372fbb732da response_code = 200 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878/state
23292024-09-23T23:19:38.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40812
23302024-09-23T23:19:38.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40812 req_id = 88c129bc-3262-4d51-a74f-dd98e2afddcb response_code = 200 uri = /vpc-routes
23312024-09-23T23:19:38.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35272
23322024-09-23T23:19:38.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35272 req_id = 4844638c-b0b4-448a-afaa-f7f6aff221c0 response_code = 200 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878/state
23332024-09-23T23:19:38.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32871
23342024-09-23T23:19:38.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32871 req_id = 2800bee3-d5d7-48a6-9d27-d39715bfd551 response_code = 200 uri = /v2p
23352024-09-23T23:19:38.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40812 req_id = d108fc30-d414-46b1-a336-91161484faf2 response_code = 204 uri = /vpc-routes
23362024-09-23T23:19:38.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45175
23372024-09-23T23:19:38.348ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
23382024-09-23T23:19:38.389ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
23392024-09-23T23:19:38.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100338 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45175 req_id = 74018e88-54d7-4eca-8b07-c923aa5f9504 response_code = 204 uri = /switch-ports
23402024-09-23T23:19:38.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43768
23412024-09-23T23:19:38.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56684
23422024-09-23T23:19:38.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39910
23432024-09-23T23:19:38.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45175 req_id = f1ee4b45-dede-4418-b707-0d528c6ae390 response_code = 200 uri = /network-bootstore-config
23442024-09-23T23:19:38.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39910 req_id = c511033c-146c-4e05-bbf3-702327598ec2 response_code = 200 uri = /vpc-routes
23452024-09-23T23:19:38.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56684 req_id = 4532deb3-abae-4b16-9565-487827401c86 response_code = 200 uri = /v2p
23462024-09-23T23:19:38.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 522 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47461 req_id = b2cc464d-0a45-4a5a-9bda-19177d3f1aac response_code = 204 uri = /vpc-routes
23472024-09-23T23:19:38.450ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
23482024-09-23T23:19:38.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42904
23492024-09-23T23:19:38.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42904 req_id = 78946e4e-89be-42e5-b9fb-a862708075e8 response_code = 200 uri = /v2p
23502024-09-23T23:19:38.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 652 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39910 req_id = 9aecd1cd-89c3-470e-92bf-a177efb0edcf response_code = 204 uri = /vpc-routes
23512024-09-23T23:19:38.489ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
23522024-09-23T23:19:38.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99447 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43768 req_id = 479e7ad2-8268-499d-b1a1-ada0f681796a response_code = 204 uri = /switch-ports
23532024-09-23T23:19:38.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43768 req_id = 49561232-8b8d-49a4-8552-878a263c8063 response_code = 200 uri = /network-bootstore-config
23542024-09-23T23:19:38.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33097
23552024-09-23T23:19:38.554ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4089
23562024-09-23T23:19:38.592ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4113
23572024-09-23T23:19:38.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93232 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33097 req_id = 67d89ca1-8d5a-4bd7-a7db-c3267172b444 response_code = 204 uri = /switch-ports
23582024-09-23T23:19:38.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33097 req_id = dc49dc57-ba52-4d58-9e5b-b2d5e0326a97 response_code = 200 uri = /network-bootstore-config
23592024-09-23T23:19:41.552ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8100 local_addr = [fd00:1122:3344:101::1]:55701 method = GET remote_addr = [fd00:1122:3344:101::d]:42658 req_id = 0ddfeb9a-f540-413a-b77f-b9567ce3c382 response_code = 200 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d uri = /a6cfeab5-1bcd-4180-8b80-d27bd607042d
23602024-09-23T23:19:46.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61286
23612024-09-23T23:19:46.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 635 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61286 req_id = 3011f361-96bb-47d4-b1cb-9667d1c7253b response_code = 200 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878/state
23622024-09-23T23:19:46.431ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-09-23T23:19:46.431765571Z } file = sled-agent/src/instance.rs:594 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23632024-09-23T23:19:46.431ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-09-23T23:19:46.431765571Z } propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23642024-09-23T23:19:46.431ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-09-23T23:19:46.431765571Z }, migration_in: None, migration_out: None }
23652024-09-23T23:19:46.443ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-09-23T23:19:46.443301314Z } file = sled-agent/src/instance.rs:594 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23662024-09-23T23:19:46.443ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-09-23T23:19:46.443301314Z } propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23672024-09-23T23:19:46.443ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:630 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23682024-09-23T23:19:46.443ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
23692024-09-23T23:19:46.443ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
23702024-09-23T23:19:46.443ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/206369d1-a9ea-498a-85ee-23c79d5662f8/debug/bundle/zone", "/pool/int/7073a935-f8ba-4ac8-91ff-452f67ec46db/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/3877506b-1f39-42fc-94ac-b2d382e6869a/crypt/debug", "/pool/ext/f28e76df-bcff-4355-b674-7f6f05c9f8dc/crypt/debug", "/pool/ext/27622737-fd47-4a66-a552-1d64c0d56a2b/crypt/debug", "/pool/ext/82bc7793-c675-49d9-9db9-2f4a2a329bef/crypt/debug", "/pool/ext/d78e334d-0261-40af-8332-4a45fd2a8d42/crypt/debug", "/pool/ext/ce967aab-6630-4925-b90b-9c9cb48e90c0/crypt/debug", "/pool/ext/fd5ca1dd-39f0-4844-af6b-77dcaa746e9d/crypt/debug", "/pool/ext/ef338e61-2c72-4f07-92cd-da33ab2266a6/crypt/debug", "/pool/ext/1be25b7d-d663-491f-9b22-294625b9b9ed/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23712024-09-23T23:19:47.086ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878", bundle_id: 6a252a69-2f0d-496b-83e2-bf97ecfd0dda }, time_created: 2024-09-23T23:19:46.444899562Z, version: 0, cause: TerminatedInstance }
23722024-09-23T23:19:47.087ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_07232b9b-c6d0-4bc1-b45b-a94bf46ac878 file = sled-agent/src/instance.rs:843 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23732024-09-23T23:19:48.843ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:270 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23742024-09-23T23:19:48.861ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:904 id = RouterId { vni: Vni(13450302), kind: System }
23752024-09-23T23:19:48.861ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:904 id = RouterId { vni: Vni(13450302), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
23762024-09-23T23:19:48.861ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-23T23:19:48.861767136Z }, migration_in: None, migration_out: None }
23772024-09-23T23:19:48.912ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-23T23:19:48.861767136Z }, migration_in: None, migration_out: None }
23782024-09-23T23:19:48.917ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:780 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
23792024-09-23T23:19:49.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55930
23802024-09-23T23:19:49.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55930 req_id = 40122bfa-6774-46a3-8628-c21ba8a39245 response_code = 200 uri = /vpc-routes
23812024-09-23T23:19:49.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55930 req_id = 07173201-4698-4063-ab0f-dc9fe63c42f6 response_code = 204 uri = /vpc-routes
23822024-09-23T23:19:49.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35375
23832024-09-23T23:19:49.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35375 req_id = a42bc52c-05b5-4aa2-bc83-67a1fbff6104 response_code = 200 uri = /v2p
23842024-09-23T23:19:49.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38895
23852024-09-23T23:19:49.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38895 req_id = 700d767b-24c7-4325-930f-ba5d0a7ef7c0 response_code = 200 uri = /v2p
23862024-09-23T23:19:50.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50180
23872024-09-23T23:19:50.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50180 req_id = c070ca97-bb7d-40ae-b97a-e5ad67900f95 response_code = 200 uri = /vpc-routes
23882024-09-23T23:19:50.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50180 req_id = 1fc765b4-efb2-4c84-9c1c-aa70b2dec4f5 response_code = 204 uri = /vpc-routes