Max level shown:
1 [ Sep 3 23:47:57 Enabled. ]
2 [ Sep 3 23:47:57 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Sep 3 23:47:57 Method "start" exited with status 0. ]
4 [ Sep 3 23:47:57 Rereading configuration. ]
5 [ Sep 3 23:47:57 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-09-03T23:47:57.647ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-09-03T23:47:57.647ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-09-03T23:47:57.699ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-09-03T23:47:57.700ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-09-03T23:47:57.812ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-09-03T23:47:57.821ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-09-03T23:47:57.829ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-09-03T23:47:58.433ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-09-03T23:47:58.569ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-09-03T23:47:58.569ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-09-03T23:47:58.569ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-09-03T23:47:58.569ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-09-03T23:47:58.570ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:716
202024-09-03T23:47:58.570ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-09-03T23:47:58.573ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:623
222024-09-03T23:47:58.573ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:765
232024-09-03T23:47:58.573ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-09-03T23:47:58.573ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:824
252024-09-03T23:47:58.573ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-09-03T23:47:58.573ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-09-03T23:47:58.573ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
282024-09-03T23:47:58.573ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-09-03T23:47:58.573ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-09-03T23:47:58.584ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:360
312024-09-03T23:47:58.584ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool)
322024-09-03T23:47:58.691ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal }
332024-09-03T23:47:59.160ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
342024-09-03T23:47:59.160ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-09-03T23:47:59.160ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-09-03T23:47:59.160ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-09-03T23:47:59.160ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
382024-09-03T23:47:59.160ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-09-03T23:47:59.160ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-09-03T23:47:59.169ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:360
412024-09-03T23:47:59.169ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = 287d8187-80e6-478c-877b-4a09970caed2 (zpool)
422024-09-03T23:47:59.279ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal }
432024-09-03T23:47:59.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-09-03T23:47:59.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-09-03T23:47:59.773ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-09-03T23:47:59.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-09-03T23:47:59.773ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
482024-09-03T23:47:59.773ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-09-03T23:47:59.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-09-03T23:47:59.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-09-03T23:47:59.773ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-09-03T23:47:59.773ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
532024-09-03T23:47:59.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-09-03T23:47:59.773ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-09-03T23:47:59.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-09-03T23:47:59.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-09-03T23:47:59.773ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582024-09-03T23:47:59.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592024-09-03T23:47:59.773ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
602024-09-03T23:47:59.773ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-09-03T23:47:59.773ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-09-03T23:47:59.773ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-09-03T23:47:59.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
642024-09-03T23:47:59.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-09-03T23:47:59.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
682024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
692024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
702024-09-03T23:47:59.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
712024-09-03T23:47:59.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
722024-09-03T23:47:59.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-09-03T23:47:59.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-09-03T23:47:59.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-09-03T23:47:59.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
782024-09-03T23:47:59.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-09-03T23:47:59.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-09-03T23:47:59.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-09-03T23:47:59.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
842024-09-03T23:47:59.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-09-03T23:47:59.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-09-03T23:47:59.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892024-09-03T23:47:59.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
902024-09-03T23:47:59.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-09-03T23:47:59.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-09-03T23:47:59.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:451
932024-09-03T23:47:59.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942024-09-03T23:47:59.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-09-03T23:47:59.774ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-09-03T23:47:59.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1002024-09-03T23:47:59.774ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1012024-09-03T23:47:59.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-09-03T23:47:59.774ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1032024-09-03T23:47:59.774ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-09-03T23:47:59.774ZINFOSledAgent (bootstore): No ledger in /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-09-03T23:47:59.774ZINFOSledAgent (bootstore): No ledger in /pool/int/287d8187-80e6-478c-877b-4a09970caed2/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-09-03T23:47:59.774ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-09-03T23:47:59.774ZINFOSledAgent (bootstore): No ledger in /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-09-03T23:47:59.774ZINFOSledAgent (bootstore): No ledger in /pool/int/287d8187-80e6-478c-877b-4a09970caed2/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-09-03T23:47:59.774ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-09-03T23:47:59.774ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-09-03T23:47:59.774ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-09-03T23:47:59.785ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:730
1132024-09-03T23:47:59.785ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1458, tv_nsec: 160047947 } time_to_next_cleanup = 599.999926958s
1142024-09-03T23:47:59.785ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3866
1152024-09-03T23:47:59.785ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1162024-09-03T23:47:59.785ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-09-03T23:47:59.785ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-09-03T23:47:59.788ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-09-03T23:47:59.788ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-09-03T23:47:59.788ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, local_pref: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1074
1212024-09-03T23:47:59.788ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
1222024-09-03T23:47:59.788ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1232024-09-03T23:47:59.788ZINFOSledAgent (RSS): No ledger in /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-09-03T23:47:59.788ZINFOSledAgent (RSS): No ledger in /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-09-03T23:47:59.788ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1137
1262024-09-03T23:47:59.788ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1272024-09-03T23:47:59.788ZINFOSledAgent (RSS): No ledger in /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-09-03T23:47:59.788ZINFOSledAgent (RSS): No ledger in /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-09-03T23:47:59.788ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1179
1302024-09-03T23:47:59.788ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:155
1312024-09-03T23:47:59.788ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:128
1322024-09-03T23:47:59.788ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1332024-09-03T23:47:59.788ZINFOSledAgent (RSS): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-09-03T23:47:59.789ZINFOSledAgent (RSS): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-09-03T23:47:59.789ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: b281022b-35b2-452e-ad2b-78e12f6ca16a, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, local_pref: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:175
1362024-09-03T23:47:59.789ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1213
1372024-09-03T23:47:59.789ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-09-03T23:47:59.789ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-09-03T23:47:59.789ZINFOSledAgent (bootstore): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-09-03T23:47:59.789ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-09-03T23:47:59.789ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:221 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: b281022b-35b2-452e-ad2b-78e12f6ca16a, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-09-03T23:47:59.789ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:62852
1432024-09-03T23:47:59.789ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: b281022b-35b2-452e-ad2b-78e12f6ca16a, rack_id: 1d4636f4-828e-412a-8daf-3bda355c92df, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:359
1442024-09-03T23:47:59.789ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:374
1452024-09-03T23:47:59.790ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1462024-09-03T23:47:59.790ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:451
1472024-09-03T23:47:59.790ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
1482024-09-03T23:47:59.790ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:644
1492024-09-03T23:47:59.790ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1502024-09-03T23:47:59.790ZINFOSledAgent (StorageManager): No ledger in /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1512024-09-03T23:47:59.790ZINFOSledAgent (StorageManager): No ledger in /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1522024-09-03T23:47:59.790ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:633
1532024-09-03T23:47:59.790ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:661
1542024-09-03T23:47:59.790ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:440
1552024-09-03T23:47:59.790ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1562024-09-03T23:47:59.790ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:532 result = DisksManagementResult { status: [] }
1572024-09-03T23:47:59.792ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4163
1582024-09-03T23:47:59.792ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4545
1592024-09-03T23:47:59.823ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1602024-09-03T23:47:59.842ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:316
1612024-09-03T23:47:59.858ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1622024-09-03T23:47:59.905ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:388 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
1632024-09-03T23:47:59.905ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1642024-09-03T23:47:59.905ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1652024-09-03T23:47:59.905ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:400 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
1662024-09-03T23:47:59.908ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 91.637309ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b2bbfccb-89f7-4c9f-af6a-d2425329e8bb", "content-length": "124", "date": "Tue, 03 Sep 2024 23:47:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b2bbfccb-89f7-4c9f-af6a-d2425329e8bb" } file = clients/ddm-admin-client/src/lib.rs:177
1672024-09-03T23:47:59.918ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_e599ee5f-97c7-4995-8dd0-33bab0f35ae9/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1682024-09-03T23:47:59.947ZINFOSledAgent: successfully created encrypted zvol: name="oxi_e599ee5f-97c7-4995-8dd0-33bab0f35ae9/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1692024-09-03T23:47:59.947ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_e599ee5f-97c7-4995-8dd0-33bab0f35ae9/swap" file = sled-agent/src/swap_device.rs:96
1702024-09-03T23:47:59.952ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:415 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
1712024-09-03T23:47:59.952ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:127
1722024-09-03T23:47:59.952ZINFOSledAgent (BackingFs): Ensuring dataset oxi_e599ee5f-97c7-4995-8dd0-33bab0f35ae9/backing/fmd file = sled-agent/src/backing_fs.rs:137
1732024-09-03T23:48:00.001ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1742024-09-03T23:48:00.002ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 154.135735ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bed15ccb-416a-4c20-bf90-fa40321639eb", "content-length": "124", "date": "Tue, 03 Sep 2024 23:47:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bed15ccb-416a-4c20-bf90-fa40321639eb" } file = clients/ddm-admin-client/src/lib.rs:177
1752024-09-03T23:48:00.056ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:172
1762024-09-03T23:48:00.157ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-09-03T23:48:00.158ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 129.237537ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e8144411-dbc2-4d12-92d0-2aa25ccf64d4", "content-length": "124", "date": "Tue, 03 Sep 2024 23:47:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e8144411-dbc2-4d12-92d0-2aa25ccf64d4" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-09-03T23:48:00.275ZINFOSledAgent (BackingFs): Mounting oxi_e599ee5f-97c7-4995-8dd0-33bab0f35ae9/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:180
1792024-09-03T23:48:00.288ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:188
1802024-09-03T23:48:00.288ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1812024-09-03T23:48:00.288ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:188
1822024-09-03T23:48:00.288ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:188
1832024-09-03T23:48:00.288ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:194
1842024-09-03T23:48:00.291ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 154.977334ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "507fb315-df4b-421e-ad22-4922193e7817", "content-length": "124", "date": "Tue, 03 Sep 2024 23:47:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "507fb315-df4b-421e-ad22-4922193e7817" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-09-03T23:48:00.447ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-09-03T23:48:00.447ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 119.773553ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9b51b27e-a7bb-4b65-a47d-264bdddddf7e", "content-length": "124", "date": "Tue, 03 Sep 2024 23:47:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9b51b27e-a7bb-4b65-a47d-264bdddddf7e" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-09-03T23:48:00.568ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-09-03T23:48:00.569ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 322.2027ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "727f56f9-b720-40c8-ae06-40a7d7e9c946", "content-length": "124", "date": "Tue, 03 Sep 2024 23:47:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "727f56f9-b720-40c8-ae06-40a7d7e9c946" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-09-03T23:48:00.892ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1902024-09-03T23:48:00.893ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 376.459238ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "54f2839b-7c3a-458a-9b8b-ebde74f0192d", "content-length": "124", "date": "Tue, 03 Sep 2024 23:48:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "54f2839b-7c3a-458a-9b8b-ebde74f0192d" } file = clients/ddm-admin-client/src/lib.rs:177
1912024-09-03T23:48:01.038ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
1922024-09-03T23:48:01.044ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:34608 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
1932024-09-03T23:48:01.044ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
1942024-09-03T23:48:01.044ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:34608 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = b281022b-35b2-452e-ad2b-78e12f6ca16a sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
1952024-09-03T23:48:01.045ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 283.811828ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
1962024-09-03T23:48:01.046ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
1972024-09-03T23:48:01.046ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
1982024-09-03T23:48:01.046ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:914 underlay_address = fd00:1122:3344:101::1
1992024-09-03T23:48:01.046ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
2002024-09-03T23:48:01.270ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2012024-09-03T23:48:01.331ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 498.291778ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
2022024-09-03T23:48:01.830ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.443650318s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
2032024-09-03T23:48:03.276ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.184954574s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
2042024-09-03T23:48:03.370ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2639
2052024-09-03T23:48:03.370ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2857
2062024-09-03T23:48:03.370ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2509
2072024-09-03T23:48:03.370ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2556
2082024-09-03T23:48:03.370ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2938
2092024-09-03T23:48:03.370ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2980
2102024-09-03T23:48:03.372ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2782
2112024-09-03T23:48:03.373ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2550
2122024-09-03T23:48:03.374ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='f2964209-c08b-4ac9-b05d-ac86b6144aa4'/> <propval type="astring" name="rack_id" value='1d4636f4-828e-412a-8daf-3bda355c92df'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe0e:8002'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='b281022b-35b2-452e-ad2b-78e12f6ca16a'/> <propval type="astring" name="rack_id" value='1d4636f4-828e-412a-8daf-3bda355c92df'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='b281022b-35b2-452e-ad2b-78e12f6ca16a'/> <propval type="astring" name="rack_uuid" value='1d4636f4-828e-412a-8daf-3bda355c92df'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='b281022b-35b2-452e-ad2b-78e12f6ca16a'/> <propval type="astring" name="rack_uuid" value='1d4636f4-828e-412a-8daf-3bda355c92df'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2132024-09-03T23:48:03.374ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2142024-09-03T23:48:03.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 39.648613ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2152024-09-03T23:48:04.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 121.649908ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-09-03T23:48:04.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 232.61872ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-09-03T23:48:04.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 527.273379ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-09-03T23:48:05.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 533.077918ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-09-03T23:48:05.463ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.592957867s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
2202024-09-03T23:48:05.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 698.68929ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-09-03T23:48:06.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.097506019s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-09-03T23:48:07.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 543.069414ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-09-03T23:48:08.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.094320136s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-09-03T23:48:09.059ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.2443875s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
2252024-09-03T23:48:09.980ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:12345
2262024-09-03T23:48:09.980ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:429
2272024-09-03T23:48:09.980ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2282024-09-03T23:48:09.980ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2292024-09-03T23:48:09.981ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2302024-09-03T23:48:09.981ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2312024-09-03T23:48:09.981ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, local_pref: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None }], bgp: [], bfd: [] })))
2322024-09-03T23:48:09.981ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:62852
2332024-09-03T23:48:09.981ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3866
2342024-09-03T23:48:09.981ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:112 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2352024-09-03T23:48:09.981ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:236 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2362024-09-03T23:48:10.188ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2372024-09-03T23:48:10.188ZINFOSledAgent (RSS): No ledger in /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/rss-service-plan-v4.json file = common/src/ledger.rs:188
2382024-09-03T23:48:10.188ZINFOSledAgent (RSS): No ledger in /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/rss-service-plan-v4.json file = common/src/ledger.rs:188
2392024-09-03T23:48:10.188ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2402024-09-03T23:48:10.188ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2412024-09-03T23:48:10.188ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2422024-09-03T23:48:10.193ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4187 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2432024-09-03T23:48:10.193ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4203
2442024-09-03T23:48:10.193ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2452024-09-03T23:48:10.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63819
2462024-09-03T23:48:10.449ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2472024-09-03T23:48:10.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63819 req_id = c79eb490-a9b7-4176-9d82-880b0741dcf6 response_code = 200 uri = /inventory
2482024-09-03T23:48:10.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58676
2492024-09-03T23:48:10.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58676 req_id = 79371b41-fd8c-4b9a-a8ea-219b19e31794 response_code = 200 uri = /sled-role
2502024-09-03T23:48:10.480ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2512024-09-03T23:48:10.480ZINFOSledAgent (RSS): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/.rss-service-plan-v4.json.tmp file = common/src/ledger.rs:199
2522024-09-03T23:48:10.481ZINFOSledAgent (RSS): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/.rss-service-plan-v4.json.tmp file = common/src/ledger.rs:199
2532024-09-03T23:48:10.481ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:1001
2542024-09-03T23:48:10.513ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 7b813309-3731-4507-a8db-2757aee52535, pool_id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: a01228d8-d18e-4eee-9eba-397e21dc4231, pool_id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: b1a1e44e-86ec-41c8-8533-132cdfdfea4e, pool_id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 8b2e1a4f-cb2b-4cc8-b8a8-83e88687a24c, pool_id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 6df7e2cd-50ca-4454-9c7e-714143079f5d, pool_id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 3a203f46-5997-4435-b2c2-e3055bb92821, pool_id: 30819714-9407-4088-b589-159a446db142 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 3f44ea20-d480-471b-b5a8-4fa6005142a4, pool_id: 96307640-3db4-4a6e-b03a-71a80f6a607d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1f6842f9-fcae-48b7-9ea4-988813ec08ea, pool_id: 4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: b1149ee8-61d6-4d91-9152-01f718771908, pool_id: 7d26dc1e-4276-483d-aac3-2ccee06bc9a7 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:375 sled_address = [fd00:1122:3344:101::1]:12345
2552024-09-03T23:48:10.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57644
2562024-09-03T23:48:10.514ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:856 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
2572024-09-03T23:48:10.514ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 7b813309-3731-4507-a8db-2757aee52535, pool_id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: a01228d8-d18e-4eee-9eba-397e21dc4231, pool_id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: b1a1e44e-86ec-41c8-8533-132cdfdfea4e, pool_id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 8b2e1a4f-cb2b-4cc8-b8a8-83e88687a24c, pool_id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 6df7e2cd-50ca-4454-9c7e-714143079f5d, pool_id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 3a203f46-5997-4435-b2c2-e3055bb92821, pool_id: 30819714-9407-4088-b589-159a446db142 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 3f44ea20-d480-471b-b5a8-4fa6005142a4, pool_id: 96307640-3db4-4a6e-b03a-71a80f6a607d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1f6842f9-fcae-48b7-9ea4-988813ec08ea, pool_id: 4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: b1149ee8-61d6-4d91-9152-01f718771908, pool_id: 7d26dc1e-4276-483d-aac3-2ccee06bc9a7 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:451
2582024-09-03T23:48:10.514ZINFOSledAgent (StorageManager): No ledger in /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2592024-09-03T23:48:10.514ZINFOSledAgent (StorageManager): No ledger in /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602024-09-03T23:48:10.514ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:866 request = omicron_physical_disks_ensure
2612024-09-03T23:48:10.514ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2622024-09-03T23:48:10.514ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2632024-09-03T23:48:10.514ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2642024-09-03T23:48:10.514ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2652024-09-03T23:48:10.686ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:360
2662024-09-03T23:48:10.686ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = e0561e5a-5452-4106-b6b0-062a7d784293 (zpool)
2672024-09-03T23:48:11.175ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b281022b-35b2-452e-ad2b-78e12f6ca16a): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
2682024-09-03T23:48:11.381ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
2692024-09-03T23:48:11.439ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }
2702024-09-03T23:48:11.447ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:218
2712024-09-03T23:48:11.447ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:220
2722024-09-03T23:48:11.447ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:224
2732024-09-03T23:48:11.447ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:226
2742024-09-03T23:48:11.447ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-09-03T23:48:11.447ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762024-09-03T23:48:11.447ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
2772024-09-03T23:48:11.490ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2782024-09-03T23:48:11.498ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e0561e5a-5452-4106-b6b0-062a7d784293/crypt/zone file = sled-storage/src/dataset.rs:281
2792024-09-03T23:48:11.704ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e0561e5a-5452-4106-b6b0-062a7d784293 file = sled-storage/src/dataset.rs:367
2802024-09-03T23:48:11.712ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2812024-09-03T23:48:11.712ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2822024-09-03T23:48:11.712ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2832024-09-03T23:48:11.712ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2842024-09-03T23:48:11.712ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2852024-09-03T23:48:11.722ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:360
2862024-09-03T23:48:11.722ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool)
2872024-09-03T23:48:11.832ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }
2882024-09-03T23:48:11.839ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:218
2892024-09-03T23:48:11.839ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:220
2902024-09-03T23:48:11.839ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:224
2912024-09-03T23:48:11.839ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:226
2922024-09-03T23:48:11.839ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-09-03T23:48:11.839ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-09-03T23:48:11.839ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
2952024-09-03T23:48:11.880ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2962024-09-03T23:48:11.889ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2cbe1d4d-d15f-4df5-bb04-76918350f53e/crypt/zone file = sled-storage/src/dataset.rs:281
2972024-09-03T23:48:12.099ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2cbe1d4d-d15f-4df5-bb04-76918350f53e file = sled-storage/src/dataset.rs:367
2982024-09-03T23:48:12.107ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2992024-09-03T23:48:12.107ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3002024-09-03T23:48:12.107ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3012024-09-03T23:48:12.107ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3022024-09-03T23:48:12.107ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032024-09-03T23:48:12.116ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:360
3042024-09-03T23:48:12.117ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 93f19386-05be-4b48-8c7f-97b089021599 (zpool)
3052024-09-03T23:48:12.229ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }
3062024-09-03T23:48:12.236ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:218
3072024-09-03T23:48:12.236ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:220
3082024-09-03T23:48:12.236ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:224
3092024-09-03T23:48:12.236ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:226
3102024-09-03T23:48:12.236ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-09-03T23:48:12.236ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-09-03T23:48:12.236ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
3132024-09-03T23:48:12.241ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b281022b-35b2-452e-ad2b-78e12f6ca16a): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
3142024-09-03T23:48:12.280ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3152024-09-03T23:48:12.287ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_93f19386-05be-4b48-8c7f-97b089021599/crypt/zone file = sled-storage/src/dataset.rs:281
3162024-09-03T23:48:12.490ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_93f19386-05be-4b48-8c7f-97b089021599 file = sled-storage/src/dataset.rs:367
3172024-09-03T23:48:12.498ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3182024-09-03T23:48:12.498ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3192024-09-03T23:48:12.498ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3202024-09-03T23:48:12.498ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3212024-09-03T23:48:12.498ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222024-09-03T23:48:12.507ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:360
3232024-09-03T23:48:12.507ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool)
3242024-09-03T23:48:12.621ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External }
3252024-09-03T23:48:12.629ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:218
3262024-09-03T23:48:12.629ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:220
3272024-09-03T23:48:12.629ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:224
3282024-09-03T23:48:12.629ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:226
3292024-09-03T23:48:12.629ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-09-03T23:48:12.629ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-09-03T23:48:12.629ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
3322024-09-03T23:48:12.671ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332024-09-03T23:48:12.679ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_004daad2-caa8-4a89-a0fc-7c1f8227b87e/crypt/zone file = sled-storage/src/dataset.rs:281
3342024-09-03T23:48:12.880ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_004daad2-caa8-4a89-a0fc-7c1f8227b87e file = sled-storage/src/dataset.rs:367
3352024-09-03T23:48:12.888ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3362024-09-03T23:48:12.888ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3372024-09-03T23:48:12.888ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3382024-09-03T23:48:12.888ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3392024-09-03T23:48:12.888ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3402024-09-03T23:48:12.898ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:360
3412024-09-03T23:48:12.898ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = f8732c0b-71fb-4387-a914-529c0b914060 (zpool)
3422024-09-03T23:48:13.011ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External }
3432024-09-03T23:48:13.019ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:218
3442024-09-03T23:48:13.019ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:220
3452024-09-03T23:48:13.019ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:224
3462024-09-03T23:48:13.019ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:226
3472024-09-03T23:48:13.019ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-09-03T23:48:13.019ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-09-03T23:48:13.019ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
3502024-09-03T23:48:13.062ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512024-09-03T23:48:13.071ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f8732c0b-71fb-4387-a914-529c0b914060/crypt/zone file = sled-storage/src/dataset.rs:281
3522024-09-03T23:48:13.243ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b281022b-35b2-452e-ad2b-78e12f6ca16a): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
3532024-09-03T23:48:13.279ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f8732c0b-71fb-4387-a914-529c0b914060 file = sled-storage/src/dataset.rs:367
3542024-09-03T23:48:13.289ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3552024-09-03T23:48:13.289ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3562024-09-03T23:48:13.289ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3572024-09-03T23:48:13.289ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3582024-09-03T23:48:13.289ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3592024-09-03T23:48:13.300ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:360
3602024-09-03T23:48:13.300ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 30819714-9407-4088-b589-159a446db142 (zpool)
3612024-09-03T23:48:13.415ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 30819714-9407-4088-b589-159a446db142 (zpool), kind: External }
3622024-09-03T23:48:13.422ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:218
3632024-09-03T23:48:13.423ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:220
3642024-09-03T23:48:13.423ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:224
3652024-09-03T23:48:13.423ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:226
3662024-09-03T23:48:13.423ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-09-03T23:48:13.423ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682024-09-03T23:48:13.423ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
3692024-09-03T23:48:13.461ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3702024-09-03T23:48:13.469ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_30819714-9407-4088-b589-159a446db142/crypt/zone file = sled-storage/src/dataset.rs:281
3712024-09-03T23:48:13.699ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_30819714-9407-4088-b589-159a446db142 file = sled-storage/src/dataset.rs:367
3722024-09-03T23:48:13.706ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3732024-09-03T23:48:13.706ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3742024-09-03T23:48:13.706ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3752024-09-03T23:48:13.706ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3762024-09-03T23:48:13.706ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3772024-09-03T23:48:13.716ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:360
3782024-09-03T23:48:13.716ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 96307640-3db4-4a6e-b03a-71a80f6a607d (zpool)
3792024-09-03T23:48:13.830ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 96307640-3db4-4a6e-b03a-71a80f6a607d (zpool), kind: External }
3802024-09-03T23:48:13.838ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:218
3812024-09-03T23:48:13.838ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:220
3822024-09-03T23:48:13.838ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:224
3832024-09-03T23:48:13.838ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:226
3842024-09-03T23:48:13.838ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-09-03T23:48:13.838ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-09-03T23:48:13.838ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
3872024-09-03T23:48:13.878ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3882024-09-03T23:48:13.885ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_96307640-3db4-4a6e-b03a-71a80f6a607d/crypt/zone file = sled-storage/src/dataset.rs:281
3892024-09-03T23:48:14.091ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_96307640-3db4-4a6e-b03a-71a80f6a607d file = sled-storage/src/dataset.rs:367
3902024-09-03T23:48:14.099ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3912024-09-03T23:48:14.099ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3922024-09-03T23:48:14.099ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3932024-09-03T23:48:14.099ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3942024-09-03T23:48:14.099ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3952024-09-03T23:48:14.108ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:360
3962024-09-03T23:48:14.108ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc (zpool)
3972024-09-03T23:48:14.227ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc (zpool), kind: External }
3982024-09-03T23:48:14.235ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:218
3992024-09-03T23:48:14.235ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:220
4002024-09-03T23:48:14.235ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:224
4012024-09-03T23:48:14.235ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:226
4022024-09-03T23:48:14.235ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-09-03T23:48:14.235ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-09-03T23:48:14.235ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
4052024-09-03T23:48:14.246ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b281022b-35b2-452e-ad2b-78e12f6ca16a): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
4062024-09-03T23:48:14.276ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072024-09-03T23:48:14.284ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc/crypt/zone file = sled-storage/src/dataset.rs:281
4082024-09-03T23:48:14.483ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc file = sled-storage/src/dataset.rs:367
4092024-09-03T23:48:14.491ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4102024-09-03T23:48:14.491ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4112024-09-03T23:48:14.491ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4122024-09-03T23:48:14.491ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4132024-09-03T23:48:14.491ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4142024-09-03T23:48:14.500ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:360
4152024-09-03T23:48:14.500ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 7d26dc1e-4276-483d-aac3-2ccee06bc9a7 (zpool)
4162024-09-03T23:48:14.612ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:174 zpool = ZpoolName { id: 7d26dc1e-4276-483d-aac3-2ccee06bc9a7 (zpool), kind: External }
4172024-09-03T23:48:14.620ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:218
4182024-09-03T23:48:14.620ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:220
4192024-09-03T23:48:14.620ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:224
4202024-09-03T23:48:14.620ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:226
4212024-09-03T23:48:14.620ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-09-03T23:48:14.620ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-09-03T23:48:14.620ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:238
4242024-09-03T23:48:14.661ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252024-09-03T23:48:14.670ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7d26dc1e-4276-483d-aac3-2ccee06bc9a7/crypt/zone file = sled-storage/src/dataset.rs:281
4262024-09-03T23:48:14.880ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7d26dc1e-4276-483d-aac3-2ccee06bc9a7 file = sled-storage/src/dataset.rs:367
4272024-09-03T23:48:14.888ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4282024-09-03T23:48:14.888ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4292024-09-03T23:48:14.888ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4302024-09-03T23:48:14.888ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e599ee5f-97c7-4995-8dd0-33bab0f35ae9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 287d8187-80e6-478c-877b-4a09970caed2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 30819714-9407-4088-b589-159a446db142 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 96307640-3db4-4a6e-b03a-71a80f6a607d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 7d26dc1e-4276-483d-aac3-2ccee06bc9a7 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4312024-09-03T23:48:14.888ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4322024-09-03T23:48:14.888ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4332024-09-03T23:48:14.889ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4342024-09-03T23:48:14.889ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:860 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
4352024-09-03T23:48:14.889ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4362024-09-03T23:48:14.889ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:886 generation = Generation(1) sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
4372024-09-03T23:48:14.889ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:891 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
4382024-09-03T23:48:14.889ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:896 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
4392024-09-03T23:48:14.889ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:121 gen = Generation(1) sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
4402024-09-03T23:48:14.889ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:902 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
4412024-09-03T23:48:14.889ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:803 gen = Generation(1)
4422024-09-03T23:48:14.889ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:907 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
4432024-09-03T23:48:14.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4375612 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57644 req_id = 25913735-841c-45e5-854f-70736451cbbc response_code = 200 uri = /omicron-physical-disks
4442024-09-03T23:48:14.922ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 32795d59-c08e-49d2-b2b0-79f550835c9d, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a7781486-6706-487a-a86f-e75908a89f03, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:458 sled_address = [fd00:1122:3344:101::1]:12345
4452024-09-03T23:48:14.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63628
4462024-09-03T23:48:14.922ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 32795d59-c08e-49d2-b2b0-79f550835c9d, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4472024-09-03T23:48:14.922ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 32795d59-c08e-49d2-b2b0-79f550835c9d, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4482024-09-03T23:48:14.981ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4492024-09-03T23:48:14.981ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: InternalDns }, responder: ... }
4502024-09-03T23:48:15.040ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a7781486-6706-487a-a86f-e75908a89f03, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4512024-09-03T23:48:15.040ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: a7781486-6706-487a-a86f-e75908a89f03, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4522024-09-03T23:48:15.101ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4532024-09-03T23:48:15.101ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/omicron-zones.json file = common/src/ledger.rs:188
4542024-09-03T23:48:15.101ZINFOSledAgent (ServiceManager): No ledger in /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/omicron-zones.json file = common/src/ledger.rs:188
4552024-09-03T23:48:15.101ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4562024-09-03T23:48:15.145ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4572024-09-03T23:48:15.145ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4582024-09-03T23:48:15.145ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4592024-09-03T23:48:15.196ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554 file = illumos-utils/src/zone.rs:316
4602024-09-03T23:48:15.200ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d file = illumos-utils/src/zone.rs:316
4612024-09-03T23:48:15.203ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03 file = illumos-utils/src/zone.rs:316
4622024-09-03T23:48:15.215ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554 file = illumos-utils/src/zone.rs:354
4632024-09-03T23:48:15.220ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d file = illumos-utils/src/zone.rs:354
4642024-09-03T23:48:15.224ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03 file = illumos-utils/src/zone.rs:354
4652024-09-03T23:48:15.249ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b281022b-35b2-452e-ad2b-78e12f6ca16a): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
4662024-09-03T23:48:16.702ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4672024-09-03T23:48:16.702ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4682024-09-03T23:48:16.702ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554
4692024-09-03T23:48:17.186ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4702024-09-03T23:48:17.666ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4712024-09-03T23:48:17.666ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4722024-09-03T23:48:17.666ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4732024-09-03T23:48:17.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554") failed: Property not found. retry in 44.763682ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554
4742024-09-03T23:48:17.674ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d
4752024-09-03T23:48:17.678ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
4762024-09-03T23:48:17.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554") failed: Property not found. retry in 140.968719ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554
4772024-09-03T23:48:17.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03") failed: Property not found. retry in 44.534579ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
4782024-09-03T23:48:17.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d") failed: Property not found. retry in 56.357195ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d
4792024-09-03T23:48:17.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03") failed: Property not found. retry in 111.199473ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
4802024-09-03T23:48:18.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d") failed: Property not found. retry in 80.97132ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d
4812024-09-03T23:48:18.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554") failed: Property not found. retry in 290.258458ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554
4822024-09-03T23:48:18.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d") failed: Property not found. retry in 151.098326ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d
4832024-09-03T23:48:18.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03") failed: Property not found. retry in 117.521888ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
4842024-09-03T23:48:18.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03") failed: Property not found. retry in 249.525463ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
4852024-09-03T23:48:18.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d") failed: Property not found. retry in 471.960254ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d
4862024-09-03T23:48:18.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554") failed: Property not found. retry in 567.167218ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554
4872024-09-03T23:48:18.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03") failed: Property not found. retry in 731.937065ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
4882024-09-03T23:48:18.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d") failed: Property not found. retry in 952.870017ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d
4892024-09-03T23:48:18.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554") failed: Property not found. retry in 867.773896ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554
4902024-09-03T23:48:19.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03") failed: Property not found. retry in 713.30836ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
4912024-09-03T23:48:19.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d") failed: Property not found. retry in 942.440211ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d
4922024-09-03T23:48:19.831ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4211
4932024-09-03T23:48:19.831ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4221 gateway = fd00:1122:3344:101::1
4942024-09-03T23:48:19.837ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4300
4952024-09-03T23:48:19.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554") failed: Property not found. retry in 1.337549801s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554
4962024-09-03T23:48:19.975ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4348
4972024-09-03T23:48:19.975ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4375
4982024-09-03T23:48:19.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03") failed: Property not found. retry in 867.348948ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
4992024-09-03T23:48:20.020ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4388
5002024-09-03T23:48:20.020ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4252
5012024-09-03T23:48:20.077ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4294
5022024-09-03T23:48:20.077ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4355 rack_subnet = fd00:1122:3344::
5032024-09-03T23:48:20.097ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4366
5042024-09-03T23:48:20.097ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4408
5052024-09-03T23:48:20.193ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4440
5062024-09-03T23:48:20.193ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4446
5072024-09-03T23:48:20.296ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4487
5082024-09-03T23:48:20.296ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:366
5092024-09-03T23:48:20.329ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 57.001136ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:385
5102024-09-03T23:48:20.387ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 64.130496ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:385
5112024-09-03T23:48:20.452ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 265.282722ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:385
5122024-09-03T23:48:20.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:43267
5132024-09-03T23:48:20.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:43267 req_id = 37b0a6f5-f06d-498e-a17e-72fb7a95a2bf response_code = 200 uri = /sled-identifiers
5142024-09-03T23:48:20.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d") failed: Property not found. retry in 975.796995ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d
5152024-09-03T23:48:20.719ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:414
5162024-09-03T23:48:20.752ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:676
5172024-09-03T23:48:20.752ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:714
5182024-09-03T23:48:20.753ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:717 uptime = 0
5192024-09-03T23:48:20.753ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:436
5202024-09-03T23:48:20.790ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
5212024-09-03T23:48:20.839ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
5222024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5232024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5242024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5252024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5262024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5272024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5282024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5292024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5302024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5312024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5322024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5332024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5342024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5352024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5362024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5372024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5382024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5392024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5402024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5412024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5422024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5432024-09-03T23:48:20.839ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5442024-09-03T23:48:20.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03") failed: Property not found. retry in 731.882957ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
5452024-09-03T23:48:21.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554") failed: Property not found. retry in 1.415032895s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554
5462024-09-03T23:48:21.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03") failed: Property not found. retry in 635.103061ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
5472024-09-03T23:48:21.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d") failed: Property not found. retry in 1.092363749s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d
5482024-09-03T23:48:22.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03") failed: Property not found. retry in 961.634128ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
5492024-09-03T23:48:22.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d") failed: Property not found. retry in 794.863538ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d
5502024-09-03T23:48:23.583ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_internal_dns_321ab50f-2ef5-4620-bbd0-13eba6f06554
5512024-09-03T23:48:23.583ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_internal_dns_32795d59-c08e-49d2-b2b0-79f550835c9d
5522024-09-03T23:48:23.583ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_internal_dns_a7781486-6706-487a-a86f-e75908a89f03
5532024-09-03T23:48:23.583ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5542024-09-03T23:48:23.584ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5552024-09-03T23:48:23.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8662138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:63628 req_id = 47c6f5c4-1f41-4f9c-9fb5-ff5d1ecbdd06 response_code = 204 uri = /omicron-zones
5562024-09-03T23:48:23.586ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:575
5572024-09-03T23:48:23.643ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:575
5582024-09-03T23:48:23.706ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:575
5592024-09-03T23:48:23.761ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:611
5602024-09-03T23:48:23.761ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5612024-09-03T23:48:23.795ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5622024-09-03T23:48:23.796ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5632024-09-03T23:48:23.796ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5642024-09-03T23:48:23.826ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 32795d59-c08e-49d2-b2b0-79f550835c9d, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a7781486-6706-487a-a86f-e75908a89f03, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ee469163-7bee-4f1a-b963-eb3781ac66a4, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0f1be2a1-a2e5-4ac3-b8ab-ba90255fd644, kind: Service { id: ee469163-7bee-4f1a-b963-eb3781ac66a4 }, name: Name("ntp-ee469163-7bee-4f1a-b963-eb3781ac66a4"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 37])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:458 sled_address = [fd00:1122:3344:101::1]:12345
5652024-09-03T23:48:23.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33059
5662024-09-03T23:48:23.827ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 32795d59-c08e-49d2-b2b0-79f550835c9d, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5672024-09-03T23:48:23.827ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 32795d59-c08e-49d2-b2b0-79f550835c9d, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5682024-09-03T23:48:23.846ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5692024-09-03T23:48:23.846ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: InternalDns }, responder: ... }
5702024-09-03T23:48:23.864ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a7781486-6706-487a-a86f-e75908a89f03, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5712024-09-03T23:48:23.864ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: a7781486-6706-487a-a86f-e75908a89f03, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5722024-09-03T23:48:23.881ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5732024-09-03T23:48:23.881ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/omicron-zones.json file = common/src/ledger.rs:177
5742024-09-03T23:48:23.881ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/omicron-zones.json file = common/src/ledger.rs:177
5752024-09-03T23:48:23.881ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5762024-09-03T23:48:23.892ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5772024-09-03T23:48:23.926ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5782024-09-03T23:48:23.927ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5792024-09-03T23:48:23.927ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5802024-09-03T23:48:23.958ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 163, 37]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5812024-09-03T23:48:23.958ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = boundary_ntp
5822024-09-03T23:48:23.958ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
5832024-09-03T23:48:23.958ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
5842024-09-03T23:48:23.958ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
5852024-09-03T23:48:23.960ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5862024-09-03T23:48:23.982ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4 file = illumos-utils/src/zone.rs:316
5872024-09-03T23:48:24.000ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4 file = illumos-utils/src/zone.rs:354
5882024-09-03T23:48:24.614ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5892024-09-03T23:48:24.615ZINFOSledAgent (ServiceManager): Booting oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4
5902024-09-03T23:48:24.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4") failed: Property not found. retry in 34.102488ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4
5912024-09-03T23:48:24.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4") failed: Property not found. retry in 142.574337ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4
5922024-09-03T23:48:24.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4") failed: Property not found. retry in 216.556678ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4
5932024-09-03T23:48:25.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4") failed: Property not found. retry in 395.053306ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4
5942024-09-03T23:48:25.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4") failed: Property not found. retry in 1.07558694s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4
5952024-09-03T23:48:26.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4") failed: Property not found. retry in 562.302459ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4
5962024-09-03T23:48:27.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4") failed: Property not found. retry in 1.020950958s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4
5972024-09-03T23:48:28.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4") failed: Property not found. retry in 731.363381ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4
5982024-09-03T23:48:29.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4") failed: Property not found. retry in 1.269726322s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4
5992024-09-03T23:48:30.325ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4
6002024-09-03T23:48:30.325ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6012024-09-03T23:48:30.326ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6022024-09-03T23:48:30.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6500082 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33059 req_id = 078abcfa-37b5-45d3-b9b7-037a164f59ce response_code = 204 uri = /omicron-zones
6032024-09-03T23:48:30.329ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:652
6042024-09-03T23:48:30.360ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6052024-09-03T23:48:30.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41754
6062024-09-03T23:48:30.368ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3852
6072024-09-03T23:48:30.368ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 8094 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41754 req_id = 6ae640cd-affd-4564-8ac8-954bf2e102b2 response_code = 500 uri = /timesync
6082024-09-03T23:48:30.371ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6092024-09-03T23:48:30.484ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6102024-09-03T23:48:30.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59583
6112024-09-03T23:48:34.491ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3852
6122024-09-03T23:48:34.491ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 4007187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59583 req_id = 5b652fba-2f83-4866-b9c0-81c5697c0713 response_code = 500 uri = /timesync
6132024-09-03T23:48:34.496ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6142024-09-03T23:48:34.685ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6152024-09-03T23:48:34.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49271
6162024-09-03T23:48:34.694ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3852
6172024-09-03T23:48:34.694ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 8325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49271 req_id = 8d5fa5a7-2797-4bd3-935d-d93f397e3449 response_code = 500 uri = /timesync
6182024-09-03T23:48:34.697ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6192024-09-03T23:48:34.820ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6202024-09-03T23:48:34.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62807
6212024-09-03T23:48:38.536ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ee469163-7bee-4f1a-b963-eb3781ac66a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3852
6222024-09-03T23:48:38.536ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 4008182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62807 req_id = 6d4d308e-bf7e-4240-9451-d0846e8515f1 response_code = 500 uri = /timesync
6232024-09-03T23:48:38.539ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6242024-09-03T23:48:39.199ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6252024-09-03T23:48:39.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64347
6262024-09-03T23:48:39.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8577 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64347 req_id = 107e69d7-fda2-4fe3-a352-63f56051476c response_code = 200 uri = /timesync
6272024-09-03T23:48:39.211ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:660
6282024-09-03T23:48:39.211ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6292024-09-03T23:48:39.409ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6302024-09-03T23:48:39.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42497
6312024-09-03T23:48:39.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7724 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42497 req_id = 20abb6f0-dc33-48ff-ae34-d0f73aa8674a response_code = 200 uri = /timesync
6322024-09-03T23:48:39.419ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:660
6332024-09-03T23:48:39.419ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6342024-09-03T23:48:39.694ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6352024-09-03T23:48:39.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45623
6362024-09-03T23:48:39.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8606 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45623 req_id = 9c9769bd-e3ef-4050-9aec-5a05735ddc5d response_code = 200 uri = /timesync
6372024-09-03T23:48:39.706ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:660
6382024-09-03T23:48:39.706ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6392024-09-03T23:48:40.022ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6402024-09-03T23:48:40.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40994
6412024-09-03T23:48:40.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8564 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40994 req_id = c7840cc1-d144-42b2-84e4-074654415014 response_code = 200 uri = /timesync
6422024-09-03T23:48:40.033ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.251929641 } file = sled-agent/src/rack_setup/service.rs:660
6432024-09-03T23:48:40.033ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6442024-09-03T23:48:40.481ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6452024-09-03T23:48:40.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33373
6462024-09-03T23:48:40.488ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 225.678153ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
6472024-09-03T23:48:40.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8597 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33373 req_id = 65062681-2b1b-453e-905a-b90c6c234b7b response_code = 200 uri = /timesync
6482024-09-03T23:48:40.494ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.25068143 } file = sled-agent/src/rack_setup/service.rs:660
6492024-09-03T23:48:40.494ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6502024-09-03T23:48:40.918ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6512024-09-03T23:48:40.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41708
6522024-09-03T23:48:40.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8453 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41708 req_id = c80a7a4f-c56d-4bde-9a14-331edb69c71f response_code = 200 uri = /timesync
6532024-09-03T23:48:40.930ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108675, ip_addr: 23.186.168.3, stratum: 3, ref_time: 1725407320.3392706, correction: -0.249866664 } file = sled-agent/src/rack_setup/service.rs:660
6542024-09-03T23:48:40.930ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6552024-09-03T23:48:41.677ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6562024-09-03T23:48:41.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37898
6572024-09-03T23:48:41.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8496 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37898 req_id = ced29c39-59c8-48b4-b9d7-b86db526d4fb response_code = 200 uri = /timesync
6582024-09-03T23:48:41.690ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1725407319.3901591, correction: -0.247805148 } file = sled-agent/src/rack_setup/service.rs:660
6592024-09-03T23:48:41.690ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6602024-09-03T23:48:42.453ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6612024-09-03T23:48:42.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48692
6622024-09-03T23:48:42.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8739 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48692 req_id = 00d223c5-8ae4-4979-b843-9678fc6fbefe response_code = 200 uri = /timesync
6632024-09-03T23:48:42.466ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1725407319.3901591, correction: -0.244461715 } file = sled-agent/src/rack_setup/service.rs:660
6642024-09-03T23:48:42.466ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6652024-09-03T23:48:43.398ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6662024-09-03T23:48:43.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56662
6672024-09-03T23:48:43.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56662 req_id = 9ae964c1-d392-45b1-849b-e9dc995f7529 response_code = 200 uri = /timesync
6682024-09-03T23:48:43.409ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1725407319.3901591, correction: -0.242355898 } file = sled-agent/src/rack_setup/service.rs:660
6692024-09-03T23:48:43.409ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6702024-09-03T23:48:44.751ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6712024-09-03T23:48:44.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39313
6722024-09-03T23:48:44.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8629 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39313 req_id = 3f34c173-b975-4aef-8fe5-1aa240f8910e response_code = 200 uri = /timesync
6732024-09-03T23:48:44.765ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108675, ip_addr: 23.186.168.3, stratum: 3, ref_time: 1725407323.5842566, correction: -0.235937715 } file = sled-agent/src/rack_setup/service.rs:660
6742024-09-03T23:48:44.765ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6752024-09-03T23:48:45.608ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6762024-09-03T23:48:45.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63639
6772024-09-03T23:48:45.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8593 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63639 req_id = 1d5149f1-2cdc-40ce-9476-300c88b7086a response_code = 200 uri = /timesync
6782024-09-03T23:48:45.619ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108675, ip_addr: 23.186.168.3, stratum: 3, ref_time: 1725407323.5842566, correction: -0.233611807 } file = sled-agent/src/rack_setup/service.rs:660
6792024-09-03T23:48:45.619ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6802024-09-03T23:48:47.362ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6812024-09-03T23:48:47.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42516
6822024-09-03T23:48:47.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8512 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42516 req_id = 0acad41a-9bcc-4a64-90f1-191b2df0690d response_code = 200 uri = /timesync
6832024-09-03T23:48:47.376ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108675, ip_addr: 23.186.168.3, stratum: 3, ref_time: 1725407325.6810925, correction: -0.228934228 } file = sled-agent/src/rack_setup/service.rs:660
6842024-09-03T23:48:47.376ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6852024-09-03T23:48:48.415ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6862024-09-03T23:48:48.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64107
6872024-09-03T23:48:48.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64107 req_id = 6ebd9139-04ed-4b68-afec-b04e62dd27a9 response_code = 200 uri = /timesync
6882024-09-03T23:48:48.428ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108675, ip_addr: 23.186.168.3, stratum: 3, ref_time: 1725407327.0053637, correction: -0.226281539 } file = sled-agent/src/rack_setup/service.rs:660
6892024-09-03T23:48:48.428ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6902024-09-03T23:48:49.775ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6912024-09-03T23:48:49.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60856
6922024-09-03T23:48:49.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8586 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60856 req_id = a762af0a-9c45-46c0-b17c-df558430d164 response_code = 200 uri = /timesync
6932024-09-03T23:48:49.788ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108675, ip_addr: 23.186.168.3, stratum: 3, ref_time: 1725407328.26255, correction: -0.222800121 } file = sled-agent/src/rack_setup/service.rs:660
6942024-09-03T23:48:49.788ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
6952024-09-03T23:48:50.138ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59878
6962024-09-03T23:48:50.138ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59878 req_id = 324fb34f-dfcd-4b82-a2c0-53c830e6648f response_code = 200 uri = /baseboard
6972024-09-03T23:48:50.958ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
6982024-09-03T23:48:50.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57995
6992024-09-03T23:48:50.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9439 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57995 req_id = 0f44d641-83b3-4369-81aa-e6eaf6523011 response_code = 200 uri = /timesync
7002024-09-03T23:48:50.971ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108675, ip_addr: 23.186.168.3, stratum: 3, ref_time: 1725407329.8327005, correction: -0.219472691 } file = sled-agent/src/rack_setup/service.rs:660
7012024-09-03T23:48:50.971ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7022024-09-03T23:48:53.867ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7032024-09-03T23:48:53.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60822
7042024-09-03T23:48:53.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8627 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60822 req_id = 4c78e0b4-2cfe-49d5-bc35-38c71df44b2a response_code = 200 uri = /timesync
7052024-09-03T23:48:53.879ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108675, ip_addr: 23.186.168.3, stratum: 3, ref_time: 1725407333.0314493, correction: -0.211369529 } file = sled-agent/src/rack_setup/service.rs:660
7062024-09-03T23:48:53.879ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7072024-09-03T23:48:55.709ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 505.337922ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
7082024-09-03T23:48:57.376ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7092024-09-03T23:48:57.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45037
7102024-09-03T23:48:57.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9055 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45037 req_id = b82ae09d-5fa3-459a-a9d8-26b0a6116f38 response_code = 200 uri = /timesync
7112024-09-03T23:48:57.389ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108675, ip_addr: 23.186.168.3, stratum: 3, ref_time: 1725407336.5319934, correction: -0.202186927 } file = sled-agent/src/rack_setup/service.rs:660
7122024-09-03T23:48:57.389ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7132024-09-03T23:48:59.854ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7142024-09-03T23:48:59.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59923
7152024-09-03T23:48:59.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8948 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59923 req_id = e684c3db-420f-43b5-93aa-6f220c257e5f response_code = 200 uri = /timesync
7162024-09-03T23:48:59.868ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108675, ip_addr: 23.186.168.3, stratum: 3, ref_time: 1725407337.6847646, correction: -0.195407391 } file = sled-agent/src/rack_setup/service.rs:660
7172024-09-03T23:48:59.868ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7182024-09-03T23:49:04.877ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7192024-09-03T23:49:04.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52146
7202024-09-03T23:49:04.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52146 req_id = 0154c5b2-efe0-4507-bf31-af85db2dcb97 response_code = 200 uri = /timesync
7212024-09-03T23:49:04.889ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108675, ip_addr: 23.186.168.3, stratum: 3, ref_time: 1725407342.17557, correction: -0.182162523 } file = sled-agent/src/rack_setup/service.rs:660
7222024-09-03T23:49:04.889ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7232024-09-03T23:49:11.208ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 585.373806ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
7242024-09-03T23:49:13.048ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7252024-09-03T23:49:13.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54798
7262024-09-03T23:49:13.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54798 req_id = edab8e15-076c-4088-be9a-63c16f668aa4 response_code = 200 uri = /timesync
7272024-09-03T23:49:13.062ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 757151060, ip_addr: 45.33.53.84, stratum: 3, ref_time: 1725407351.1908765, correction: -0.155893594 } file = sled-agent/src/rack_setup/service.rs:660
7282024-09-03T23:49:13.062ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7292024-09-03T23:49:17.837ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7302024-09-03T23:49:17.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65376
7312024-09-03T23:49:17.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8643 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65376 req_id = 198476c9-e216-49fb-9e87-eedd7553eede response_code = 200 uri = /timesync
7322024-09-03T23:49:17.850ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 757151060, ip_addr: 45.33.53.84, stratum: 3, ref_time: 1725407356.725133, correction: -0.142705634 } file = sled-agent/src/rack_setup/service.rs:660
7332024-09-03T23:49:17.850ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7342024-09-03T23:49:20.091ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59736
7352024-09-03T23:49:20.091ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59736 req_id = 8e33f431-d59f-48bb-b021-d0a8bdd90b27 response_code = 200 uri = /baseboard
7362024-09-03T23:49:23.759ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7372024-09-03T23:49:23.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46278
7382024-09-03T23:49:23.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46278 req_id = d9ad2b0a-72f7-4d91-ae2c-c626497270e5 response_code = 200 uri = /timesync
7392024-09-03T23:49:23.771ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 757151060, ip_addr: 45.33.53.84, stratum: 3, ref_time: 1725407362.2207575, correction: -0.126677796 } file = sled-agent/src/rack_setup/service.rs:660
7402024-09-03T23:49:23.771ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7412024-09-03T23:49:26.786ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.521823579s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
7422024-09-03T23:49:32.473ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7432024-09-03T23:49:32.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35993
7442024-09-03T23:49:32.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8841 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35993 req_id = 189755af-6431-4398-8b52-b50ab6997a89 response_code = 200 uri = /timesync
7452024-09-03T23:49:32.485ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 757151060, ip_addr: 45.33.53.84, stratum: 3, ref_time: 1725407371.7547672, correction: -0.103092492 } file = sled-agent/src/rack_setup/service.rs:660
7462024-09-03T23:49:32.485ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7472024-09-03T23:49:40.058ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7482024-09-03T23:49:40.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33832
7492024-09-03T23:49:40.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33832 req_id = 1aacbbb4-8453-4be9-b2d6-e58005403279 response_code = 200 uri = /timesync
7502024-09-03T23:49:40.070ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 757151060, ip_addr: 45.33.53.84, stratum: 3, ref_time: 1725407376.9758902, correction: -0.082547113 } file = sled-agent/src/rack_setup/service.rs:660
7512024-09-03T23:49:40.070ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:682
7522024-09-03T23:49:43.299ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.885773926s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
7532024-09-03T23:49:50.047ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64201
7542024-09-03T23:49:50.048ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 595 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64201 req_id = 92bfb24d-2a65-4eeb-af9f-0b7b59a10a40 response_code = 200 uri = /baseboard
7552024-09-03T23:49:59.822ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:632
7562024-09-03T23:49:59.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37556
7572024-09-03T23:49:59.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 21723 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37556 req_id = 645bbf71-3395-4846-989e-628cd90fec83 response_code = 200 uri = /timesync
7582024-09-03T23:49:59.847ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 757151060, ip_addr: 45.33.53.84, stratum: 3, ref_time: 1725407397.2725897, correction: -0.029011063 } file = sled-agent/src/rack_setup/service.rs:660
7592024-09-03T23:49:59.847ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1299
7602024-09-03T23:49:59.877ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 32795d59-c08e-49d2-b2b0-79f550835c9d, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a7781486-6706-487a-a86f-e75908a89f03, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ee469163-7bee-4f1a-b963-eb3781ac66a4, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0f1be2a1-a2e5-4ac3-b8ab-ba90255fd644, kind: Service { id: ee469163-7bee-4f1a-b963-eb3781ac66a4 }, name: Name("ntp-ee469163-7bee-4f1a-b963-eb3781ac66a4"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 37])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 4383c204-64ba-4bab-a39e-38e47356cccf, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External } } } }, OmicronZoneConfig { id: 350c3deb-8f79-4d10-8049-b1571d1ac8cf, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External } } } }, OmicronZoneConfig { id: ab337643-0c6f-4833-88e0-fed0109558a3, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External } } } }, OmicronZoneConfig { id: 46755ef6-4a2c-4170-aa01-ca3971f3a9f2, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External } } } }, OmicronZoneConfig { id: 6bb73854-c1c5-4fb5-92eb-8dcc64210205, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:458 sled_address = [fd00:1122:3344:101::1]:12345
7612024-09-03T23:49:59.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50815
7622024-09-03T23:49:59.878ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 32795d59-c08e-49d2-b2b0-79f550835c9d, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7632024-09-03T23:49:59.878ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 32795d59-c08e-49d2-b2b0-79f550835c9d, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7642024-09-03T23:49:59.898ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7652024-09-03T23:49:59.898ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: InternalDns }, responder: ... }
7662024-09-03T23:49:59.916ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a7781486-6706-487a-a86f-e75908a89f03, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7672024-09-03T23:49:59.916ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: a7781486-6706-487a-a86f-e75908a89f03, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7682024-09-03T23:49:59.934ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4383c204-64ba-4bab-a39e-38e47356cccf, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7692024-09-03T23:49:59.934ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 4383c204-64ba-4bab-a39e-38e47356cccf, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7702024-09-03T23:49:59.994ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 350c3deb-8f79-4d10-8049-b1571d1ac8cf, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7712024-09-03T23:49:59.994ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 350c3deb-8f79-4d10-8049-b1571d1ac8cf, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: Cockroach }, responder: ... }
7722024-09-03T23:50:00.056ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ab337643-0c6f-4833-88e0-fed0109558a3, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7732024-09-03T23:50:00.056ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: ab337643-0c6f-4833-88e0-fed0109558a3, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7742024-09-03T23:50:00.116ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 46755ef6-4a2c-4170-aa01-ca3971f3a9f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7752024-09-03T23:50:00.116ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 46755ef6-4a2c-4170-aa01-ca3971f3a9f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External }, kind: Cockroach }, responder: ... }
7762024-09-03T23:50:00.179ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6bb73854-c1c5-4fb5-92eb-8dcc64210205, dataset_name: DatasetName { pool_name: ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7772024-09-03T23:50:00.179ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 6bb73854-c1c5-4fb5-92eb-8dcc64210205, dataset_name: DatasetName { pool_name: ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7782024-09-03T23:50:00.237ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7792024-09-03T23:50:00.237ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/omicron-zones.json file = common/src/ledger.rs:177
7802024-09-03T23:50:00.237ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/omicron-zones.json file = common/src/ledger.rs:177
7812024-09-03T23:50:00.237ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7822024-09-03T23:50:00.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7832024-09-03T23:50:00.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7842024-09-03T23:50:00.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7852024-09-03T23:50:00.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7862024-09-03T23:50:00.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7872024-09-03T23:50:00.413ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf file = illumos-utils/src/zone.rs:316
7882024-09-03T23:50:00.417ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3 file = illumos-utils/src/zone.rs:316
7892024-09-03T23:50:00.421ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf file = illumos-utils/src/zone.rs:316
7902024-09-03T23:50:00.426ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2 file = illumos-utils/src/zone.rs:316
7912024-09-03T23:50:00.430ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205 file = illumos-utils/src/zone.rs:316
7922024-09-03T23:50:00.435ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf file = illumos-utils/src/zone.rs:354
7932024-09-03T23:50:00.439ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3 file = illumos-utils/src/zone.rs:354
7942024-09-03T23:50:00.443ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf file = illumos-utils/src/zone.rs:354
7952024-09-03T23:50:00.448ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2 file = illumos-utils/src/zone.rs:354
7962024-09-03T23:50:00.452ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205 file = illumos-utils/src/zone.rs:354
7972024-09-03T23:50:03.458ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4383c204-64ba-4bab-a39e-38e47356cccf'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7982024-09-03T23:50:03.458ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
7992024-09-03T23:50:03.464ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='6bb73854-c1c5-4fb5-92eb-8dcc64210205'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8002024-09-03T23:50:03.464ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8012024-09-03T23:50:03.483ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='46755ef6-4a2c-4170-aa01-ca3971f3a9f2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8022024-09-03T23:50:03.483ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8032024-09-03T23:50:03.576ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ab337643-0c6f-4833-88e0-fed0109558a3'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8042024-09-03T23:50:03.576ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8052024-09-03T23:50:03.591ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='350c3deb-8f79-4d10-8049-b1571d1ac8cf'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8062024-09-03T23:50:03.591ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8072024-09-03T23:50:03.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 70.400035ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8082024-09-03T23:50:03.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 56.127429ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8092024-09-03T23:50:03.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 46.417221ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8102024-09-03T23:50:03.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 94.45659ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8112024-09-03T23:50:04.171ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.796280063s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
8122024-09-03T23:50:04.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 116.370208ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8132024-09-03T23:50:04.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 180.11226ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8142024-09-03T23:50:04.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 118.346982ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8152024-09-03T23:50:04.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 163.99437ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8162024-09-03T23:50:04.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3") failed: Property not found. retry in 27.489373ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8172024-09-03T23:50:04.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf") failed: Property not found. retry in 68.827165ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8182024-09-03T23:50:05.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 457.404345ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8192024-09-03T23:50:05.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 126.038266ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8202024-09-03T23:50:05.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 496.67658ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8212024-09-03T23:50:05.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3") failed: Property not found. retry in 117.431469ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8222024-09-03T23:50:05.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf") failed: Property not found. retry in 139.680487ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8232024-09-03T23:50:05.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 240.344992ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8242024-09-03T23:50:05.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 788.60497ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8252024-09-03T23:50:05.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3") failed: Property not found. retry in 286.583922ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8262024-09-03T23:50:05.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf") failed: Property not found. retry in 298.731971ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8272024-09-03T23:50:05.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 680.985975ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8282024-09-03T23:50:05.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 410.636725ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8292024-09-03T23:50:05.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3") failed: Property not found. retry in 255.824208ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8302024-09-03T23:50:06.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf") failed: Property not found. retry in 357.953017ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8312024-09-03T23:50:06.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 1.499949294s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8322024-09-03T23:50:06.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3") failed: Property not found. retry in 665.707605ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8332024-09-03T23:50:06.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 1.211703484s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8342024-09-03T23:50:06.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf") failed: Property not found. retry in 705.365385ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8352024-09-03T23:50:06.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 1.085815878s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8362024-09-03T23:50:06.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3") failed: Property not found. retry in 1.193665696s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8372024-09-03T23:50:07.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf") failed: Property not found. retry in 953.787764ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8382024-09-03T23:50:07.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 777.173039ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8392024-09-03T23:50:07.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 1.1327175s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8402024-09-03T23:50:07.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 764.573334ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8412024-09-03T23:50:08.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf") failed: Property not found. retry in 1.32925519s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8422024-09-03T23:50:08.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3") failed: Property not found. retry in 1.405327218s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8432024-09-03T23:50:08.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 571.771503ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8442024-09-03T23:50:08.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 672.393619ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8452024-09-03T23:50:08.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 1.003935898s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8462024-09-03T23:50:08.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 750.649016ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8472024-09-03T23:50:09.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 893.501333ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8482024-09-03T23:50:09.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf") failed: Property not found. retry in 1.25486953s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8492024-09-03T23:50:09.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3") failed: Property not found. retry in 743.334612ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8502024-09-03T23:50:09.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 1.407846248s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8512024-09-03T23:50:09.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 624.379492ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8522024-09-03T23:50:10.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 1.097740333s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8532024-09-03T23:50:10.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3") failed: Property not found. retry in 989.006238ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8542024-09-03T23:50:10.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 1.086282918s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8552024-09-03T23:50:10.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf") failed: Property not found. retry in 937.747431ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8562024-09-03T23:50:11.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 737.507809ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8572024-09-03T23:50:11.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 878.620938ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8582024-09-03T23:50:11.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3") failed: Property not found. retry in 1.024000809s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8592024-09-03T23:50:11.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 1.324149019s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8602024-09-03T23:50:11.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf") failed: Property not found. retry in 665.869387ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8612024-09-03T23:50:11.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 1.338190454s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8622024-09-03T23:50:12.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 570.775839ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8632024-09-03T23:50:12.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 929.728134ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8642024-09-03T23:50:12.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 762.591223ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8652024-09-03T23:50:13.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 784.375372ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8662024-09-03T23:50:13.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 772.058746ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8672024-09-03T23:50:13.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 1.195804234s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8682024-09-03T23:50:13.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 1.275016762s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8692024-09-03T23:50:14.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 1.073822376s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8702024-09-03T23:50:15.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 927.477624ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8712024-09-03T23:50:15.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 939.194165ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8722024-09-03T23:50:15.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 1.107270623s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8732024-09-03T23:50:16.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 1.390758929s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8742024-09-03T23:50:16.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 639.74251ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8752024-09-03T23:50:16.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 1.307123765s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8762024-09-03T23:50:16.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 931.140178ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8772024-09-03T23:50:17.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 1.204704333s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8782024-09-03T23:50:17.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 699.819604ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8792024-09-03T23:50:18.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 978.355411ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8802024-09-03T23:50:18.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 863.821514ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8812024-09-03T23:50:18.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 952.683486ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8822024-09-03T23:50:19.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 776.433973ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8832024-09-03T23:50:19.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 1.052531671s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8842024-09-03T23:50:19.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 1.256730581s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8852024-09-03T23:50:19.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 506.184613ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8862024-09-03T23:50:20.023ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64846
8872024-09-03T23:50:20.024ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64846 req_id = 254f91f8-ad11-47e5-b80c-e849d05002b1 response_code = 200 uri = /baseboard
8882024-09-03T23:50:20.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 1.165469532s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8892024-09-03T23:50:20.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2") failed: Property not found. retry in 1.318939711s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8902024-09-03T23:50:20.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 635.938693ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8912024-09-03T23:50:21.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205") failed: Property not found. retry in 1.493634993s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8922024-09-03T23:50:21.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf") failed: Property not found. retry in 1.327497241s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8932024-09-03T23:50:23.108ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_cockroachdb_4383c204-64ba-4bab-a39e-38e47356cccf
8942024-09-03T23:50:23.108ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_cockroachdb_ab337643-0c6f-4833-88e0-fed0109558a3
8952024-09-03T23:50:23.108ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_cockroachdb_350c3deb-8f79-4d10-8049-b1571d1ac8cf
8962024-09-03T23:50:23.108ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_cockroachdb_46755ef6-4a2c-4170-aa01-ca3971f3a9f2
8972024-09-03T23:50:23.108ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_cockroachdb_6bb73854-c1c5-4fb5-92eb-8dcc64210205
8982024-09-03T23:50:23.108ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8992024-09-03T23:50:23.109ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9002024-09-03T23:50:23.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 23263114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50815 req_id = 3c30ced6-a53b-4f1b-81b1-f39bb8edb10d response_code = 204 uri = /omicron-zones
9012024-09-03T23:50:23.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51500
9022024-09-03T23:50:23.173ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3686
9032024-09-03T23:50:23.361ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3704
9042024-09-03T23:50:31.579ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 20.505900803s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
9052024-09-03T23:50:41.816ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3727
9062024-09-03T23:50:41.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 18672606 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51500 req_id = 9c179998-fd6f-4e03-96ec-4b4162dd4f99 response_code = 204 uri = /cockroachdb
9072024-09-03T23:50:41.861ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 32795d59-c08e-49d2-b2b0-79f550835c9d, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a7781486-6706-487a-a86f-e75908a89f03, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ee469163-7bee-4f1a-b963-eb3781ac66a4, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0f1be2a1-a2e5-4ac3-b8ab-ba90255fd644, kind: Service { id: ee469163-7bee-4f1a-b963-eb3781ac66a4 }, name: Name("ntp-ee469163-7bee-4f1a-b963-eb3781ac66a4"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 37])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 4383c204-64ba-4bab-a39e-38e47356cccf, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External } } } }, OmicronZoneConfig { id: 350c3deb-8f79-4d10-8049-b1571d1ac8cf, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External } } } }, OmicronZoneConfig { id: ab337643-0c6f-4833-88e0-fed0109558a3, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External } } } }, OmicronZoneConfig { id: 46755ef6-4a2c-4170-aa01-ca3971f3a9f2, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External } } } }, OmicronZoneConfig { id: 6bb73854-c1c5-4fb5-92eb-8dcc64210205, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External } } } }, OmicronZoneConfig { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee, underlay_address: fd00:1122:3344:101::8, filesystem_pool: Some(ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd, underlay_address: fd00:1122:3344:101::9, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850, underlay_address: fd00:1122:3344:101::a, filesystem_pool: Some(ZpoolName { id: 30819714-9407-4088-b589-159a446db142 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 6a103559-9ed4-4654-9b5e-18577b1b0579, underlay_address: fd00:1122:3344:101::b, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 5f5ce676-2064-4d97-b873-fbcbc29495de, underlay_address: fd00:1122:3344:101::c, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 022d3a36-e465-40ec-b1ab-e6f9700e76c8, underlay_address: fd00:1122:3344:101::d, filesystem_pool: Some(ZpoolName { id: 30819714-9407-4088-b589-159a446db142 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 459a8b74-d3de-4789-8d88-72460d758c4a, underlay_address: fd00:1122:3344:101::e, filesystem_pool: Some(ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External } } } }, OmicronZoneConfig { id: c362209c-ab4a-4b4d-b442-f772b6412748, underlay_address: fd00:1122:3344:101::f, filesystem_pool: Some(ZpoolName { id: 96307640-3db4-4a6e-b03a-71a80f6a607d (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: b81b2636-6705-4a22-9025-e3494caf5f20, underlay_address: fd00:1122:3344:101::10, filesystem_pool: Some(ZpoolName { id: 7d26dc1e-4276-483d-aac3-2ccee06bc9a7 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 360e22da-de3f-4904-943e-712d8bf5114c, underlay_address: fd00:1122:3344:101::11, filesystem_pool: Some(ZpoolName { id: 4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 2d4f823e-f7e0-4a33-b36b-1896d239b71f, underlay_address: fd00:1122:3344:101::12, filesystem_pool: Some(ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External } } } }, OmicronZoneConfig { id: c178de41-39da-44da-b28c-efd94022c7de, underlay_address: fd00:1122:3344:101::13, filesystem_pool: Some(ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External } } } }, OmicronZoneConfig { id: 69c63c12-bcf3-4c66-841c-9be9bd48eb10, underlay_address: fd00:1122:3344:101::14, filesystem_pool: Some(ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External } } } }, OmicronZoneConfig { id: 234bef4b-0876-4208-a0b2-121ea1c066c2, underlay_address: fd00:1122:3344:101::15, filesystem_pool: Some(ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External } } } }, OmicronZoneConfig { id: 68418520-7eab-4618-a51b-311909ef87bf, underlay_address: fd00:1122:3344:101::16, filesystem_pool: Some(ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9a5dbe61-b2de-4ba8-a649-256fc4cda471, underlay_address: fd00:1122:3344:101::17, filesystem_pool: Some(ZpoolName { id: 30819714-9407-4088-b589-159a446db142 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 30819714-9407-4088-b589-159a446db142 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b, underlay_address: fd00:1122:3344:101::18, filesystem_pool: Some(ZpoolName { id: 96307640-3db4-4a6e-b03a-71a80f6a607d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96307640-3db4-4a6e-b03a-71a80f6a607d (zpool), kind: External } } } }, OmicronZoneConfig { id: 10ccec05-fc20-47e2-b3a9-36fcc9ec9a47, underlay_address: fd00:1122:3344:101::19, filesystem_pool: Some(ZpoolName { id: 4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc (zpool), kind: External } } } }, OmicronZoneConfig { id: e1f0345b-166c-4cf7-b862-b09cefca7db4, underlay_address: fd00:1122:3344:101::1a, filesystem_pool: Some(ZpoolName { id: 7d26dc1e-4276-483d-aac3-2ccee06bc9a7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7d26dc1e-4276-483d-aac3-2ccee06bc9a7 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:458 sled_address = [fd00:1122:3344:101::1]:12345
9082024-09-03T23:50:41.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53842
9092024-09-03T23:50:41.866ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 32795d59-c08e-49d2-b2b0-79f550835c9d, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9102024-09-03T23:50:41.866ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 32795d59-c08e-49d2-b2b0-79f550835c9d, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9112024-09-03T23:50:41.895ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9122024-09-03T23:50:41.895ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 321ab50f-2ef5-4620-bbd0-13eba6f06554, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: InternalDns }, responder: ... }
9132024-09-03T23:50:41.915ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a7781486-6706-487a-a86f-e75908a89f03, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9142024-09-03T23:50:41.915ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: a7781486-6706-487a-a86f-e75908a89f03, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9152024-09-03T23:50:41.934ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4383c204-64ba-4bab-a39e-38e47356cccf, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9162024-09-03T23:50:41.935ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 4383c204-64ba-4bab-a39e-38e47356cccf, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9172024-09-03T23:50:41.954ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 350c3deb-8f79-4d10-8049-b1571d1ac8cf, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9182024-09-03T23:50:41.954ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 350c3deb-8f79-4d10-8049-b1571d1ac8cf, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: Cockroach }, responder: ... }
9192024-09-03T23:50:41.972ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ab337643-0c6f-4833-88e0-fed0109558a3, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9202024-09-03T23:50:41.972ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: ab337643-0c6f-4833-88e0-fed0109558a3, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9212024-09-03T23:50:41.990ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 46755ef6-4a2c-4170-aa01-ca3971f3a9f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9222024-09-03T23:50:41.990ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 46755ef6-4a2c-4170-aa01-ca3971f3a9f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External }, kind: Cockroach }, responder: ... }
9232024-09-03T23:50:42.009ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6bb73854-c1c5-4fb5-92eb-8dcc64210205, dataset_name: DatasetName { pool_name: ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9242024-09-03T23:50:42.009ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 6bb73854-c1c5-4fb5-92eb-8dcc64210205, dataset_name: DatasetName { pool_name: ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9252024-09-03T23:50:42.029ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 90a0c753-ce30-4bd3-a374-17c504cb8aee, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9262024-09-03T23:50:42.030ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 90a0c753-ce30-4bd3-a374-17c504cb8aee, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9272024-09-03T23:50:42.203ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9282024-09-03T23:50:42.203ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9292024-09-03T23:50:42.365ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 459a8b74-d3de-4789-8d88-72460d758c4a, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:451
9302024-09-03T23:50:42.365ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 459a8b74-d3de-4789-8d88-72460d758c4a, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9312024-09-03T23:50:42.582ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2d4f823e-f7e0-4a33-b36b-1896d239b71f, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9322024-09-03T23:50:42.582ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 2d4f823e-f7e0-4a33-b36b-1896d239b71f, dataset_name: DatasetName { pool_name: ZpoolName { id: e0561e5a-5452-4106-b6b0-062a7d784293 (zpool), kind: External }, kind: Crucible }, responder: ... }
9332024-09-03T23:50:42.904ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c178de41-39da-44da-b28c-efd94022c7de, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9342024-09-03T23:50:42.904ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: c178de41-39da-44da-b28c-efd94022c7de, dataset_name: DatasetName { pool_name: ZpoolName { id: 2cbe1d4d-d15f-4df5-bb04-76918350f53e (zpool), kind: External }, kind: Crucible }, responder: ... }
9352024-09-03T23:50:43.139ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69c63c12-bcf3-4c66-841c-9be9bd48eb10, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9362024-09-03T23:50:43.139ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 69c63c12-bcf3-4c66-841c-9be9bd48eb10, dataset_name: DatasetName { pool_name: ZpoolName { id: 93f19386-05be-4b48-8c7f-97b089021599 (zpool), kind: External }, kind: Crucible }, responder: ... }
9372024-09-03T23:50:43.300ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 234bef4b-0876-4208-a0b2-121ea1c066c2, dataset_name: DatasetName { pool_name: ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9382024-09-03T23:50:43.300ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 234bef4b-0876-4208-a0b2-121ea1c066c2, dataset_name: DatasetName { pool_name: ZpoolName { id: 004daad2-caa8-4a89-a0fc-7c1f8227b87e (zpool), kind: External }, kind: Crucible }, responder: ... }
9392024-09-03T23:50:43.583ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 68418520-7eab-4618-a51b-311909ef87bf, dataset_name: DatasetName { pool_name: ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9402024-09-03T23:50:43.583ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 68418520-7eab-4618-a51b-311909ef87bf, dataset_name: DatasetName { pool_name: ZpoolName { id: f8732c0b-71fb-4387-a914-529c0b914060 (zpool), kind: External }, kind: Crucible }, responder: ... }
9412024-09-03T23:50:43.866ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9a5dbe61-b2de-4ba8-a649-256fc4cda471, dataset_name: DatasetName { pool_name: ZpoolName { id: 30819714-9407-4088-b589-159a446db142 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9422024-09-03T23:50:43.866ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 9a5dbe61-b2de-4ba8-a649-256fc4cda471, dataset_name: DatasetName { pool_name: ZpoolName { id: 30819714-9407-4088-b589-159a446db142 (zpool), kind: External }, kind: Crucible }, responder: ... }
9432024-09-03T23:50:44.145ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b, dataset_name: DatasetName { pool_name: ZpoolName { id: 96307640-3db4-4a6e-b03a-71a80f6a607d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9442024-09-03T23:50:44.145ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b, dataset_name: DatasetName { pool_name: ZpoolName { id: 96307640-3db4-4a6e-b03a-71a80f6a607d (zpool), kind: External }, kind: Crucible }, responder: ... }
9452024-09-03T23:50:44.324ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 10ccec05-fc20-47e2-b3a9-36fcc9ec9a47, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9462024-09-03T23:50:44.324ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: 10ccec05-fc20-47e2-b3a9-36fcc9ec9a47, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc (zpool), kind: External }, kind: Crucible }, responder: ... }
9472024-09-03T23:50:44.514ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e1f0345b-166c-4cf7-b862-b09cefca7db4, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d26dc1e-4276-483d-aac3-2ccee06bc9a7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9482024-09-03T23:50:44.514ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1065 request = NewFilesystemRequest { dataset_id: e1f0345b-166c-4cf7-b862-b09cefca7db4, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d26dc1e-4276-483d-aac3-2ccee06bc9a7 (zpool), kind: External }, kind: Crucible }, responder: ... }
9492024-09-03T23:50:44.729ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9502024-09-03T23:50:44.729ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/omicron-zones.json file = common/src/ledger.rs:177
9512024-09-03T23:50:44.729ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/omicron-zones.json file = common/src/ledger.rs:177
9522024-09-03T23:50:44.729ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9532024-09-03T23:50:44.890ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9542024-09-03T23:50:44.892ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9552024-09-03T23:50:44.907ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9562024-09-03T23:50:44.907ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9572024-09-03T23:50:44.908ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9582024-09-03T23:50:44.967ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9592024-09-03T23:50:44.968ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9602024-09-03T23:50:44.968ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9612024-09-03T23:50:44.968ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9622024-09-03T23:50:44.968ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9632024-09-03T23:50:45.137ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9642024-09-03T23:50:45.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9652024-09-03T23:50:45.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9662024-09-03T23:50:45.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9672024-09-03T23:50:45.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9682024-09-03T23:50:45.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9692024-09-03T23:50:45.163ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9702024-09-03T23:50:45.163ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9712024-09-03T23:50:45.163ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9722024-09-03T23:50:45.164ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8 file = illumos-utils/src/zone.rs:316
9732024-09-03T23:50:45.171ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20 file = illumos-utils/src/zone.rs:316
9742024-09-03T23:50:45.176ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f file = illumos-utils/src/zone.rs:316
9752024-09-03T23:50:45.182ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf file = illumos-utils/src/zone.rs:316
9762024-09-03T23:50:45.188ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de file = illumos-utils/src/zone.rs:316
9772024-09-03T23:50:45.193ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47 file = illumos-utils/src/zone.rs:316
9782024-09-03T23:50:45.350ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8 file = illumos-utils/src/zone.rs:354
9792024-09-03T23:50:45.391ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9802024-09-03T23:50:45.391ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20 file = illumos-utils/src/zone.rs:354
9812024-09-03T23:50:45.397ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f file = illumos-utils/src/zone.rs:354
9822024-09-03T23:50:45.401ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf file = illumos-utils/src/zone.rs:354
9832024-09-03T23:50:45.405ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de file = illumos-utils/src/zone.rs:354
9842024-09-03T23:50:45.410ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47 file = illumos-utils/src/zone.rs:354
9852024-09-03T23:50:45.414ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a file = illumos-utils/src/zone.rs:316
9862024-09-03T23:50:45.419ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748 file = illumos-utils/src/zone.rs:316
9872024-09-03T23:50:45.424ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10 file = illumos-utils/src/zone.rs:316
9882024-09-03T23:50:45.429ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2 file = illumos-utils/src/zone.rs:316
9892024-09-03T23:50:45.434ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b file = illumos-utils/src/zone.rs:316
9902024-09-03T23:50:45.440ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471 file = illumos-utils/src/zone.rs:316
9912024-09-03T23:50:45.445ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c file = illumos-utils/src/zone.rs:316
9922024-09-03T23:50:45.450ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4 file = illumos-utils/src/zone.rs:316
9932024-09-03T23:50:45.494ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9942024-09-03T23:50:45.494ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a file = illumos-utils/src/zone.rs:354
9952024-09-03T23:50:45.501ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748 file = illumos-utils/src/zone.rs:354
9962024-09-03T23:50:45.506ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10 file = illumos-utils/src/zone.rs:354
9972024-09-03T23:50:45.510ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2 file = illumos-utils/src/zone.rs:354
9982024-09-03T23:50:45.515ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b file = illumos-utils/src/zone.rs:354
9992024-09-03T23:50:45.520ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471 file = illumos-utils/src/zone.rs:354
10002024-09-03T23:50:45.525ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c file = illumos-utils/src/zone.rs:354
10012024-09-03T23:50:45.530ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4 file = illumos-utils/src/zone.rs:354
10022024-09-03T23:50:45.577ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
10032024-09-03T23:50:45.615ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
10042024-09-03T23:50:45.619ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10052024-09-03T23:50:45.619ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10062024-09-03T23:50:45.672ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 145, 61]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10072024-09-03T23:50:45.672ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = nexus
10082024-09-03T23:50:45.675ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10092024-09-03T23:50:45.675ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10102024-09-03T23:50:45.722ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 251, 48]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10112024-09-03T23:50:45.722ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = external_dns
10122024-09-03T23:50:45.763ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
10132024-09-03T23:50:45.765ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10142024-09-03T23:50:45.765ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10152024-09-03T23:50:45.814ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 129, 187]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10162024-09-03T23:50:45.814ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = nexus
10172024-09-03T23:50:45.816ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10182024-09-03T23:50:45.816ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10192024-09-03T23:50:45.888ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 138, 121]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10202024-09-03T23:50:45.888ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = external_dns
10212024-09-03T23:50:45.889ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
10222024-09-03T23:50:45.889ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
10232024-09-03T23:50:45.892ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
10242024-09-03T23:50:45.896ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
10252024-09-03T23:50:45.896ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
10262024-09-03T23:50:45.897ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10272024-09-03T23:50:45.931ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10282024-09-03T23:50:45.931ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10292024-09-03T23:50:45.989ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 232, 221]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10302024-09-03T23:50:45.989ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1234 zone_type = nexus
10312024-09-03T23:50:46.029ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
10322024-09-03T23:50:46.034ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
10332024-09-03T23:50:46.034ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
10342024-09-03T23:50:46.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10352024-09-03T23:50:46.035ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
10362024-09-03T23:50:46.035ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
10372024-09-03T23:50:46.075ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
10382024-09-03T23:50:46.079ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
10392024-09-03T23:50:46.083ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10402024-09-03T23:50:46.083ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10412024-09-03T23:50:46.083ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de file = illumos-utils/src/zone.rs:316
10422024-09-03T23:50:46.172ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
10432024-09-03T23:50:46.172ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
10442024-09-03T23:50:46.172ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de file = illumos-utils/src/zone.rs:354
10452024-09-03T23:50:46.187ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee file = illumos-utils/src/zone.rs:316
10462024-09-03T23:50:46.203ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579 file = illumos-utils/src/zone.rs:316
10472024-09-03T23:50:46.223ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd file = illumos-utils/src/zone.rs:316
10482024-09-03T23:50:46.238ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
10492024-09-03T23:50:46.242ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10502024-09-03T23:50:46.243ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee file = illumos-utils/src/zone.rs:354
10512024-09-03T23:50:46.252ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579 file = illumos-utils/src/zone.rs:354
10522024-09-03T23:50:46.306ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd file = illumos-utils/src/zone.rs:354
10532024-09-03T23:50:46.332ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850 file = illumos-utils/src/zone.rs:316
10542024-09-03T23:50:46.371ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850 file = illumos-utils/src/zone.rs:354
10552024-09-03T23:50:47.635ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10562024-09-03T23:50:47.635ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10572024-09-03T23:50:47.635ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
10582024-09-03T23:50:47.642ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
10592024-09-03T23:50:47.755ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e0561e5a-5452-4106-b6b0-062a7d784293/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='40b02778-2c2b-4481-9b22-23498f2e71ed'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10602024-09-03T23:50:47.755ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
10612024-09-03T23:50:47.763ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f8732c0b-71fb-4387-a914-529c0b914060/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bc5ff986-e9a1-4324-9bcd-6199e8c5895f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10622024-09-03T23:50:47.763ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2cbe1d4d-d15f-4df5-bb04-76918350f53e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d2ac9fcd-52e2-47ce-9fc8-c526f2398660'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10632024-09-03T23:50:47.764ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9619c345-dfb4-4054-a5bd-651d77dc9bd7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10642024-09-03T23:50:47.764ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_93f19386-05be-4b48-8c7f-97b089021599/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='49783203-4027-47f6-bac6-1e1f359a4e6e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10652024-09-03T23:50:47.764ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_004daad2-caa8-4a89-a0fc-7c1f8227b87e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c2c4eae1-1821-403c-8593-4c9a88e5c41f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10662024-09-03T23:50:47.764ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_30819714-9407-4088-b589-159a446db142/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9516b48d-8f7c-4b60-b7d1-eb3c0daea49a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10672024-09-03T23:50:47.764ZINFOSledAgent (ServiceManager): Booting oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
10682024-09-03T23:50:47.771ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
10692024-09-03T23:50:47.778ZINFOSledAgent (ServiceManager): Booting oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
10702024-09-03T23:50:47.785ZINFOSledAgent (ServiceManager): Booting oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
10712024-09-03T23:50:47.791ZINFOSledAgent (ServiceManager): Booting oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
10722024-09-03T23:50:47.796ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
10732024-09-03T23:50:47.916ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='022d3a36-e465-40ec-b1ab-e6f9700e76c8'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10742024-09-03T23:50:47.916ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
10752024-09-03T23:50:48.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 50.243822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
10762024-09-03T23:50:48.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 28.612208ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
10772024-09-03T23:50:48.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 45.675463ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
10782024-09-03T23:50:48.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 30.862692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
10792024-09-03T23:50:48.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 69.485263ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
10802024-09-03T23:50:48.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 73.376386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
10812024-09-03T23:50:48.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 67.258374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
10822024-09-03T23:50:48.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 53.43924ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
10832024-09-03T23:50:48.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 68.307056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
10842024-09-03T23:50:48.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 35.291301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
10852024-09-03T23:50:48.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 105.461879ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
10862024-09-03T23:50:48.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 77.959422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
10872024-09-03T23:50:48.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 143.376862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
10882024-09-03T23:50:49.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 142.274831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
10892024-09-03T23:50:49.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 90.405918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
10902024-09-03T23:50:49.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 63.78961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
10912024-09-03T23:50:49.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 66.335635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
10922024-09-03T23:50:49.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 54.941698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
10932024-09-03T23:50:49.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 103.477652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
10942024-09-03T23:50:49.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 50.633814ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
10952024-09-03T23:50:49.956ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10962024-09-03T23:50:49.958ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7d26dc1e-4276-483d-aac3-2ccee06bc9a7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='11df0af6-b423-44d3-ba36-a3b57eac84d1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10972024-09-03T23:50:49.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 248.305569ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
10982024-09-03T23:50:49.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 117.402171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
10992024-09-03T23:50:50.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 270.573393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
11002024-09-03T23:50:50.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 190.305025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
11012024-09-03T23:50:50.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 293.455329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
11022024-09-03T23:50:50.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 162.046803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
11032024-09-03T23:50:50.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 292.303726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
11042024-09-03T23:50:50.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 190.559094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
11052024-09-03T23:50:50.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 109.210882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
11062024-09-03T23:50:50.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 174.959586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
11072024-09-03T23:50:50.113ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
11082024-09-03T23:50:50.120ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
11092024-09-03T23:50:50.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 311.368023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
11102024-09-03T23:50:50.142ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_96307640-3db4-4a6e-b03a-71a80f6a607d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9cad33d1-810d-4cd2-bfe6-3de13c448a12'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11112024-09-03T23:50:50.142ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
11122024-09-03T23:50:50.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 368.361443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
11132024-09-03T23:50:50.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 263.695812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
11142024-09-03T23:50:50.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 509.113613ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
11152024-09-03T23:50:50.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 316.529302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
11162024-09-03T23:50:50.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 387.943018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
11172024-09-03T23:50:50.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 344.090063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
11182024-09-03T23:50:50.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 399.810706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
11192024-09-03T23:50:50.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 333.34019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
11202024-09-03T23:50:50.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 53.84222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
11212024-09-03T23:50:50.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 67.468566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
11222024-09-03T23:50:50.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 476.455616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
11232024-09-03T23:50:50.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 53.552229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
11242024-09-03T23:50:50.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 128.376181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
11252024-09-03T23:50:50.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 88.663243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
11262024-09-03T23:50:50.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 144.326151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
11272024-09-03T23:50:50.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.160889833s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
11282024-09-03T23:50:50.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 691.215509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
11292024-09-03T23:50:50.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 297.322862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
11302024-09-03T23:50:50.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 222.237002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
11312024-09-03T23:50:50.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.153106976s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
11322024-09-03T23:50:50.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 577.620473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
11332024-09-03T23:50:50.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 142.671441ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
11342024-09-03T23:50:50.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 560.643622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
11352024-09-03T23:50:50.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 705.267773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
11362024-09-03T23:50:50.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 921.448009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
11372024-09-03T23:50:50.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.103565296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
11382024-09-03T23:50:50.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 685.395839ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
11392024-09-03T23:50:50.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 543.740739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
11402024-09-03T23:50:50.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 360.831896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
11412024-09-03T23:50:50.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 401.442742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
11422024-09-03T23:50:50.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.159783105s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
11432024-09-03T23:50:51.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 897.181332ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
11442024-09-03T23:50:51.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 1.330572297s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
11452024-09-03T23:50:51.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.466460718s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
11462024-09-03T23:50:51.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.010142076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
11472024-09-03T23:50:51.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.074556311s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
11482024-09-03T23:50:51.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 739.815112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
11492024-09-03T23:50:51.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 1.336990005s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
11502024-09-03T23:50:51.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 891.444139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
11512024-09-03T23:50:51.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 536.583154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
11522024-09-03T23:50:51.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 651.789283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
11532024-09-03T23:50:51.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 742.324089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
11542024-09-03T23:50:51.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 838.761212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
11552024-09-03T23:50:51.962ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57210
11562024-09-03T23:50:52.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.29550795s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
11572024-09-03T23:50:52.071ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 25995 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57210 req_id = 05c47554-e205-4a50-aa92-33f5b2cd8fbb response_code = 200 uri = /baseboard
11582024-09-03T23:50:52.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 816.410059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
11592024-09-03T23:50:52.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 943.818264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
11602024-09-03T23:50:52.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 755.883695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
11612024-09-03T23:50:52.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.127072045s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
11622024-09-03T23:50:52.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 799.419932ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
11632024-09-03T23:50:52.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 956.528844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
11642024-09-03T23:50:52.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 593.647027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
11652024-09-03T23:50:52.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 891.214021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
11662024-09-03T23:50:52.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 995.699815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
11672024-09-03T23:50:52.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 655.963356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
11682024-09-03T23:50:52.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 674.268261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
11692024-09-03T23:50:52.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 515.200036ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
11702024-09-03T23:50:52.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 663.221873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
11712024-09-03T23:50:53.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 532.636626ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
11722024-09-03T23:50:53.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 732.425624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
11732024-09-03T23:50:53.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.198104606s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
11742024-09-03T23:50:53.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.317718247s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
11752024-09-03T23:50:53.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 871.027064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
11762024-09-03T23:50:53.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 530.739491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
11772024-09-03T23:50:53.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.38593771s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
11782024-09-03T23:50:53.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 852.113443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
11792024-09-03T23:50:53.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.469231357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
11802024-09-03T23:50:53.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 662.655286ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
11812024-09-03T23:50:53.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.415723562s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
11822024-09-03T23:50:53.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 1.250468573s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
11832024-09-03T23:50:53.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.248331448s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
11842024-09-03T23:50:53.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 667.697941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
11852024-09-03T23:50:53.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 1.482420467s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
11862024-09-03T23:50:53.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 570.373724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
11872024-09-03T23:50:54.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 1.079866315s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
11882024-09-03T23:50:54.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.225276421s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
11892024-09-03T23:50:54.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.199905532s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
11902024-09-03T23:50:54.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.302156388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
11912024-09-03T23:50:54.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 644.050679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
11922024-09-03T23:50:54.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.287436225s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
11932024-09-03T23:50:54.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.139526134s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
11942024-09-03T23:50:54.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 653.374775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
11952024-09-03T23:50:54.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 884.564943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
11962024-09-03T23:50:54.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 644.822614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
11972024-09-03T23:50:54.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.117557218s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
11982024-09-03T23:50:54.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.209409104s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
11992024-09-03T23:50:55.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.212460748s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
12002024-09-03T23:50:55.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 585.905538ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
12012024-09-03T23:50:55.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 909.143546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
12022024-09-03T23:50:55.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 527.193434ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
12032024-09-03T23:50:55.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.287893816s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
12042024-09-03T23:50:55.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.088552293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
12052024-09-03T23:50:55.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.137993097s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
12062024-09-03T23:50:55.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 614.692331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
12072024-09-03T23:50:55.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.098709142s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
12082024-09-03T23:50:55.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 677.578816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
12092024-09-03T23:50:55.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 562.967807ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
12102024-09-03T23:50:55.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 1.305832235s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
12112024-09-03T23:50:55.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.026869144s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
12122024-09-03T23:50:56.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.413254502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
12132024-09-03T23:50:56.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.13143354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
12142024-09-03T23:50:56.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.170396947s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
12152024-09-03T23:50:56.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 648.745698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
12162024-09-03T23:50:56.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 790.562175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
12172024-09-03T23:50:56.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 952.78449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
12182024-09-03T23:50:56.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 1.481082042s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
12192024-09-03T23:50:56.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 812.477824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
12202024-09-03T23:50:56.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.370722327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
12212024-09-03T23:50:56.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.498499747s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
12222024-09-03T23:50:56.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 818.017669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
12232024-09-03T23:50:56.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 594.404173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
12242024-09-03T23:50:57.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.01892626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
12252024-09-03T23:50:57.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 817.352475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
12262024-09-03T23:50:57.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 771.308326ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
12272024-09-03T23:50:57.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.402703676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
12282024-09-03T23:50:57.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.340933544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
12292024-09-03T23:50:57.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.272590632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
12302024-09-03T23:50:57.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 740.02516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
12312024-09-03T23:50:57.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.200037436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
12322024-09-03T23:50:57.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 1.420045869s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
12332024-09-03T23:50:57.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.033042681s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
12342024-09-03T23:50:57.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 907.56065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
12352024-09-03T23:50:57.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 545.083961ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
12362024-09-03T23:50:57.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.448745273s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
12372024-09-03T23:50:58.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.483974777s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
12382024-09-03T23:50:58.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.182401062s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
12392024-09-03T23:50:58.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.314444937s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
12402024-09-03T23:50:58.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 926.165556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
12412024-09-03T23:50:58.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 957.27843ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
12422024-09-03T23:50:58.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 901.950691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
12432024-09-03T23:50:58.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.347665754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
12442024-09-03T23:50:58.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.317367378s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
12452024-09-03T23:50:58.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.224596295s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
12462024-09-03T23:50:58.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 712.946365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
12472024-09-03T23:50:58.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 1.038336604s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
12482024-09-03T23:50:58.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 918.707596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
12492024-09-03T23:50:59.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.415148697s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
12502024-09-03T23:50:59.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.317042252s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
12512024-09-03T23:50:59.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 874.623064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
12522024-09-03T23:50:59.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 942.277468ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
12532024-09-03T23:50:59.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.038289155s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
12542024-09-03T23:50:59.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.344008065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
12552024-09-03T23:50:59.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.113302953s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
12562024-09-03T23:50:59.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.318652568s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
12572024-09-03T23:50:59.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 785.788683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
12582024-09-03T23:50:59.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 1.30164628s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
12592024-09-03T23:51:00.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.229797298s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
12602024-09-03T23:51:00.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.275570848s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
12612024-09-03T23:51:00.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.096148146s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
12622024-09-03T23:51:00.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.19789291s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
12632024-09-03T23:51:00.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 765.049567ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
12642024-09-03T23:51:00.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.463278297s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
12652024-09-03T23:51:00.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 923.356505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
12662024-09-03T23:51:00.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.254648897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
12672024-09-03T23:51:00.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 1.416667318s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
12682024-09-03T23:51:00.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.454684502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
12692024-09-03T23:51:00.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.196727168s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
12702024-09-03T23:51:00.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.272098534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
12712024-09-03T23:51:01.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 666.370226ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
12722024-09-03T23:51:01.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 1.049653307s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
12732024-09-03T23:51:01.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.186184746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
12742024-09-03T23:51:01.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 945.035449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
12752024-09-03T23:51:01.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.081642963s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
12762024-09-03T23:51:01.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.327998448s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
12772024-09-03T23:51:01.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.341686963s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
12782024-09-03T23:51:01.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 962.310501ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
12792024-09-03T23:51:01.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 699.034248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
12802024-09-03T23:51:02.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 588.8744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
12812024-09-03T23:51:02.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.074761138s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
12822024-09-03T23:51:02.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 1.375804062s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
12832024-09-03T23:51:02.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 503.458332ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
12842024-09-03T23:51:02.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.402116709s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
12852024-09-03T23:51:02.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.383399383s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
12862024-09-03T23:51:02.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 1.107532928s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
12872024-09-03T23:51:02.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 697.420508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
12882024-09-03T23:51:02.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 718.839527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
12892024-09-03T23:51:02.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.313644502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
12902024-09-03T23:51:02.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.249448096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
12912024-09-03T23:51:02.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.157343479s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
12922024-09-03T23:51:02.734ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12932024-09-03T23:51:02.736ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
12942024-09-03T23:51:02.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 665.714951ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
12952024-09-03T23:51:02.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 1.411819385s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
12962024-09-03T23:51:02.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 902.783777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
12972024-09-03T23:51:03.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 46.547872ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
12982024-09-03T23:51:03.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 137.734479ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
12992024-09-03T23:51:03.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.494143196s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
13002024-09-03T23:51:03.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 599.6384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
13012024-09-03T23:51:03.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 167.348189ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
13022024-09-03T23:51:03.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 571.895239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
13032024-09-03T23:51:03.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 634.113053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
13042024-09-03T23:51:03.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.205382991s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
13052024-09-03T23:51:03.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 796.665076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
13062024-09-03T23:51:03.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 551.432161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
13072024-09-03T23:51:03.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.010165627s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
13082024-09-03T23:51:03.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 244.879802ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
13092024-09-03T23:51:03.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.066205185s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
13102024-09-03T23:51:03.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.471342501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
13112024-09-03T23:51:03.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.127583979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
13122024-09-03T23:51:03.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 612.549989ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
13132024-09-03T23:51:03.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 733.983608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
13142024-09-03T23:51:03.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.124946682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
13152024-09-03T23:51:04.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 1.420534594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
13162024-09-03T23:51:04.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 1.133842667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
13172024-09-03T23:51:04.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.359949315s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
13182024-09-03T23:51:04.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 531.808876ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
13192024-09-03T23:51:04.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.224076931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
13202024-09-03T23:51:04.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 819.251232ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
13212024-09-03T23:51:04.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.021889458s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
13222024-09-03T23:51:04.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 826.675009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
13232024-09-03T23:51:04.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.388857018s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
13242024-09-03T23:51:04.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 708.020643ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
13252024-09-03T23:51:04.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 751.534746ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
13262024-09-03T23:51:04.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 694.524947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
13272024-09-03T23:51:05.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.304917159s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
13282024-09-03T23:51:05.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 867.433479ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
13292024-09-03T23:51:05.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 969.253728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
13302024-09-03T23:51:05.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 983.142611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
13312024-09-03T23:51:05.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 1.060513984s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
13322024-09-03T23:51:05.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 1.240754805s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
13332024-09-03T23:51:05.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 1.06723081s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
13342024-09-03T23:51:05.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.105507426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
13352024-09-03T23:51:05.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.301567108s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
13362024-09-03T23:51:05.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 915.020225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
13372024-09-03T23:51:05.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 847.955096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
13382024-09-03T23:51:05.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.157187819s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
13392024-09-03T23:51:05.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.241211336s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
13402024-09-03T23:51:05.824ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13412024-09-03T23:51:05.824ZINFOSledAgent (ServiceManager): Booting oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
13422024-09-03T23:51:06.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 566.58255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
13432024-09-03T23:51:06.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 49.19514ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
13442024-09-03T23:51:06.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 123.654332ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
13452024-09-03T23:51:06.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.128539775s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
13462024-09-03T23:51:06.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 251.802145ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
13472024-09-03T23:51:06.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 625.042587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
13482024-09-03T23:51:06.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 754.770407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
13492024-09-03T23:51:06.304ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="clickhouse_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13502024-09-03T23:51:06.304ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
13512024-09-03T23:51:06.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 520.977852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
13522024-09-03T23:51:06.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 555.110528ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
13532024-09-03T23:51:06.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.248531486s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
13542024-09-03T23:51:06.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 304.821137ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
13552024-09-03T23:51:06.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.208100506s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
13562024-09-03T23:51:06.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 59.649836ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
13572024-09-03T23:51:06.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 968.034032ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
13582024-09-03T23:51:06.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 59.731231ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
13592024-09-03T23:51:06.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 590.62197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
13602024-09-03T23:51:06.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.049343096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
13612024-09-03T23:51:06.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 219.286899ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
13622024-09-03T23:51:06.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 909.052445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
13632024-09-03T23:51:06.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 1.097758623s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
13642024-09-03T23:51:06.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.349121721s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
13652024-09-03T23:51:06.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.199477973s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
13662024-09-03T23:51:06.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 450.309723ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
13672024-09-03T23:51:06.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.236322395s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
13682024-09-03T23:51:06.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.306584939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
13692024-09-03T23:51:06.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 778.441352ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
13702024-09-03T23:51:07.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 600.405304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
13712024-09-03T23:51:07.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.378501587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
13722024-09-03T23:51:07.155ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 44.652122143s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
13732024-09-03T23:51:07.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 753.560963ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
13742024-09-03T23:51:07.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 598.069893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
13752024-09-03T23:51:07.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 431.719636ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
13762024-09-03T23:51:07.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 1.200564977s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
13772024-09-03T23:51:07.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 780.925393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
13782024-09-03T23:51:07.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.447595701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
13792024-09-03T23:51:07.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 651.056822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
13802024-09-03T23:51:07.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.05271107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
13812024-09-03T23:51:07.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.048166669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
13822024-09-03T23:51:07.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 675.698843ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
13832024-09-03T23:51:07.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 1.169261922s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
13842024-09-03T23:51:07.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.192161844s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
13852024-09-03T23:51:07.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 1.31569296s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
13862024-09-03T23:51:07.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.328089339s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
13872024-09-03T23:51:08.033ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13882024-09-03T23:51:08.034ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
13892024-09-03T23:51:08.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 582.103575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
13902024-09-03T23:51:08.130ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13912024-09-03T23:51:08.130ZINFOSledAgent (ServiceManager): Booting oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
13922024-09-03T23:51:08.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.252149754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
13932024-09-03T23:51:08.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd") failed: Property not found. retry in 72.205808ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
13942024-09-03T23:51:08.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.179077888s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
13952024-09-03T23:51:08.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de") failed: Property not found. retry in 64.538146ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
13962024-09-03T23:51:08.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.106832477s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
13972024-09-03T23:51:08.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd") failed: Property not found. retry in 135.633571ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
13982024-09-03T23:51:08.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de") failed: Property not found. retry in 94.453978ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
13992024-09-03T23:51:08.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 1.085505701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
14002024-09-03T23:51:08.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 1.09843427s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
14012024-09-03T23:51:08.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 1.396188917s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
14022024-09-03T23:51:08.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 845.218283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
14032024-09-03T23:51:08.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de") failed: Property not found. retry in 213.017792ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
14042024-09-03T23:51:08.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd") failed: Property not found. retry in 205.305729ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
14052024-09-03T23:51:08.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.465341868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
14062024-09-03T23:51:08.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de") failed: Property not found. retry in 555.402246ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
14072024-09-03T23:51:08.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd") failed: Property not found. retry in 429.188144ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
14082024-09-03T23:51:08.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 790.508995ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
14092024-09-03T23:51:08.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 613.693377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
14102024-09-03T23:51:08.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.341018816s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
14112024-09-03T23:51:08.955ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14122024-09-03T23:51:08.955ZINFOSledAgent (ServiceManager): Booting oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
14132024-09-03T23:51:08.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 651.649956ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
14142024-09-03T23:51:09.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.206344188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
14152024-09-03T23:51:09.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.214831511s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
14162024-09-03T23:51:09.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd") failed: Property not found. retry in 533.814682ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
14172024-09-03T23:51:09.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 66.81621ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
14182024-09-03T23:51:09.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 963.311459ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
14192024-09-03T23:51:09.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 70.039084ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
14202024-09-03T23:51:09.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.499616139s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
14212024-09-03T23:51:09.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de") failed: Property not found. retry in 726.451597ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
14222024-09-03T23:51:09.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 295.958244ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
14232024-09-03T23:51:09.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.122763669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
14242024-09-03T23:51:09.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.124840184s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
14252024-09-03T23:51:09.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 958.34453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
14262024-09-03T23:51:09.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.46911676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
14272024-09-03T23:51:09.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.361996391s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
14282024-09-03T23:51:09.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 591.140603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
14292024-09-03T23:51:09.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 882.465318ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
14302024-09-03T23:51:09.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 560.555806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
14312024-09-03T23:51:09.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 890.712696ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
14322024-09-03T23:51:09.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 535.203783ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
14332024-09-03T23:51:09.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd") failed: Property not found. retry in 1.272753598s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
14342024-09-03T23:51:09.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 545.94689ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
14352024-09-03T23:51:10.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 1.042883279s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
14362024-09-03T23:51:10.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de") failed: Property not found. retry in 952.089162ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
14372024-09-03T23:51:10.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 836.688762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
14382024-09-03T23:51:10.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.435840753s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
14392024-09-03T23:51:10.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 1.013537365s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
14402024-09-03T23:51:10.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 642.802701ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
14412024-09-03T23:51:10.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 1.150099743s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
14422024-09-03T23:51:10.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.430836611s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
14432024-09-03T23:51:10.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 626.897288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
14442024-09-03T23:51:10.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 774.426559ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
14452024-09-03T23:51:10.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 1.390727441s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
14462024-09-03T23:51:10.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 853.5468ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
14472024-09-03T23:51:10.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.373670912s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
14482024-09-03T23:51:10.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 752.145591ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
14492024-09-03T23:51:10.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.313077069s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
14502024-09-03T23:51:10.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 770.134517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
14512024-09-03T23:51:10.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 665.05224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
14522024-09-03T23:51:10.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 1.09447408s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
14532024-09-03T23:51:10.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 766.192668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
14542024-09-03T23:51:11.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 1.388941266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
14552024-09-03T23:51:11.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 806.045763ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
14562024-09-03T23:51:11.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd") failed: Property not found. retry in 1.277675705s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
14572024-09-03T23:51:11.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de") failed: Property not found. retry in 1.424262534s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
14582024-09-03T23:51:11.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 656.099334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
14592024-09-03T23:51:11.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.138842221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
14602024-09-03T23:51:11.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 1.202635662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
14612024-09-03T23:51:11.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 1.195654254s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
14622024-09-03T23:51:11.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 696.513869ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
14632024-09-03T23:51:11.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 973.142511ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
14642024-09-03T23:51:11.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.386735708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
14652024-09-03T23:51:11.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 712.088856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
14662024-09-03T23:51:11.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 575.5878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
14672024-09-03T23:51:11.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.026478553s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
14682024-09-03T23:51:11.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.085232264s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
14692024-09-03T23:51:11.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 521.288884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
14702024-09-03T23:51:11.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.06034153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
14712024-09-03T23:51:11.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 712.625845ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
14722024-09-03T23:51:11.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.474257709s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
14732024-09-03T23:51:11.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.345859596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
14742024-09-03T23:51:11.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 1.1958633s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
14752024-09-03T23:51:12.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 923.436133ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
14762024-09-03T23:51:12.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 891.308318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
14772024-09-03T23:51:12.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd") failed: Property not found. retry in 1.082915939s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
14782024-09-03T23:51:12.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 520.505806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
14792024-09-03T23:51:12.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.207987043s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
14802024-09-03T23:51:12.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 524.975915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
14812024-09-03T23:51:12.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 1.328343684s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
14822024-09-03T23:51:12.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 681.096974ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
14832024-09-03T23:51:12.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 651.922077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
14842024-09-03T23:51:12.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de") failed: Property not found. retry in 1.011506898s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
14852024-09-03T23:51:12.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 691.771243ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
14862024-09-03T23:51:12.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 627.840492ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
14872024-09-03T23:51:12.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.091765102s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
14882024-09-03T23:51:12.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748") failed: Property not found. retry in 1.388826748s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
14892024-09-03T23:51:12.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 523.878093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
14902024-09-03T23:51:12.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 664.485197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
14912024-09-03T23:51:12.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 1.397326314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
14922024-09-03T23:51:12.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 1.102920163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
14932024-09-03T23:51:12.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8") failed: Property not found. retry in 1.3564551s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
14942024-09-03T23:51:13.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 737.025942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
14952024-09-03T23:51:13.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 917.247648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
14962024-09-03T23:51:13.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 1.338833374s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
14972024-09-03T23:51:13.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 742.752688ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
14982024-09-03T23:51:13.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 1.338723657s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
14992024-09-03T23:51:13.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 726.512019ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
15002024-09-03T23:51:13.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 502.278068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
15012024-09-03T23:51:13.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.438491612s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
15022024-09-03T23:51:13.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2") failed: Property not found. retry in 1.36015812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
15032024-09-03T23:51:13.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd") failed: Property not found. retry in 1.498870467s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
15042024-09-03T23:51:13.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de") failed: Property not found. retry in 1.091487487s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
15052024-09-03T23:51:13.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.110908735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
15062024-09-03T23:51:13.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 891.814588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
15072024-09-03T23:51:13.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 1.481301775s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
15082024-09-03T23:51:13.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 827.266029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
15092024-09-03T23:51:13.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.105718595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
15102024-09-03T23:51:13.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b") failed: Property not found. retry in 764.02362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
15112024-09-03T23:51:13.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 1.383087002s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
15122024-09-03T23:51:13.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 543.939685ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
15132024-09-03T23:51:14.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 828.422016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
15142024-09-03T23:51:14.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471") failed: Property not found. retry in 556.697605ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
15152024-09-03T23:51:14.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c") failed: Property not found. retry in 929.913353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
15162024-09-03T23:51:14.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4") failed: Property not found. retry in 917.167934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
15172024-09-03T23:51:14.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf") failed: Property not found. retry in 823.16406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
15182024-09-03T23:51:14.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a") failed: Property not found. retry in 1.473959476s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
15192024-09-03T23:51:14.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee") failed: Property not found. retry in 1.103630463s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
15202024-09-03T23:51:14.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47") failed: Property not found. retry in 1.064635001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
15212024-09-03T23:51:14.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de") failed: Property not found. retry in 1.272008262s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
15222024-09-03T23:51:14.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20") failed: Property not found. retry in 1.082352135s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
15232024-09-03T23:51:14.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10") failed: Property not found. retry in 1.355223972s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
15242024-09-03T23:51:14.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de") failed: Property not found. retry in 1.188752424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
15252024-09-03T23:51:14.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd") failed: Property not found. retry in 644.179161ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
15262024-09-03T23:51:14.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f") failed: Property not found. retry in 1.438620348s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
15272024-09-03T23:51:15.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 1.030644535s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
15282024-09-03T23:51:15.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850") failed: Property not found. retry in 874.87714ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
15292024-09-03T23:51:15.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd") failed: Property not found. retry in 1.394241406s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
15302024-09-03T23:51:16.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de") failed: Property not found. retry in 1.261646722s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
15312024-09-03T23:51:16.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 1.212537695s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
15322024-09-03T23:51:17.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 647.784451ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
15332024-09-03T23:51:18.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579") failed: Property not found. retry in 955.10635ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
15342024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_oximeter_022d3a36-e465-40ec-b1ab-e6f9700e76c8
15352024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_nexus_5f5ce676-2064-4d97-b873-fbcbc29495de
15362024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_pantry_b81b2636-6705-4a22-9025-e3494caf5f20
15372024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_external_dns_90a0c753-ce30-4bd3-a374-17c504cb8aee
15382024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_nexus_6a103559-9ed4-4654-9b5e-18577b1b0579
15392024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_2d4f823e-f7e0-4a33-b36b-1896d239b71f
15402024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_68418520-7eab-4618-a51b-311909ef87bf
15412024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_c178de41-39da-44da-b28c-efd94022c7de
15422024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_10ccec05-fc20-47e2-b3a9-36fcc9ec9a47
15432024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_external_dns_1f2af9fb-1e02-483c-afd2-2b8742b46afd
15442024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_clickhouse_459a8b74-d3de-4789-8d88-72460d758c4a
15452024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_pantry_c362209c-ab4a-4b4d-b442-f772b6412748
15462024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_69c63c12-bcf3-4c66-841c-9be9bd48eb10
15472024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_234bef4b-0876-4208-a0b2-121ea1c066c2
15482024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_1a6f3e5a-2cdb-4c34-95f5-d34ccbd9f67b
15492024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_nexus_5a19fea2-ef2a-4710-a2dc-f909b9134850
15502024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_9a5dbe61-b2de-4ba8-a649-256fc4cda471
15512024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_pantry_360e22da-de3f-4904-943e-712d8bf5114c
15522024-09-03T23:51:19.182ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3250 zone = oxz_crucible_e1f0345b-166c-4cf7-b862-b09cefca7db4
15532024-09-03T23:51:19.184ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15542024-09-03T23:51:19.187ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15552024-09-03T23:51:19.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 37325979 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53842 req_id = 2dd8e8b5-ee35-4e6e-9062-5b134bc31cba response_code = 204 uri = /omicron-zones
15562024-09-03T23:51:19.196ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1322
15572024-09-03T23:51:19.197ZINFOSledAgent (RSS): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15582024-09-03T23:51:19.197ZINFOSledAgent (RSS): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15592024-09-03T23:51:19.203ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:707
15602024-09-03T23:51:19.204ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:720
15612024-09-03T23:51:19.246ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), local_pref: None, nexthop: 10.151.1.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:887
15622024-09-03T23:51:19.250ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15632024-09-03T23:51:19.303ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15642024-09-03T23:51:19.390ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15652024-09-03T23:51:19.605ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15662024-09-03T23:51:19.820ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15672024-09-03T23:51:20.040ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15682024-09-03T23:51:20.190ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15692024-09-03T23:51:20.455ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15702024-09-03T23:51:20.795ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15712024-09-03T23:51:21.319ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15722024-09-03T23:51:21.729ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15732024-09-03T23:51:22.087ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15742024-09-03T23:51:22.118ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34452
15752024-09-03T23:51:22.118ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34452 req_id = 0c8d4b00-7f33-4fab-ae03-1079ea1f8ecb response_code = 200 uri = /baseboard
15762024-09-03T23:51:23.071ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15772024-09-03T23:51:24.231ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15782024-09-03T23:51:24.860ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15792024-09-03T23:51:26.467ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15802024-09-03T23:51:27.874ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15812024-09-03T23:51:29.000ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15822024-09-03T23:51:31.288ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15832024-09-03T23:51:34.473ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15842024-09-03T23:51:36.858ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/1d4636f4-828e-412a-8daf-3bda355c92df/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:949
15852024-09-03T23:51:41.551ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:544 new_generation = 1 old_generation = 1 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
15862024-09-03T23:51:41.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42434
15872024-09-03T23:51:41.644ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15882024-09-03T23:51:41.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 85145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42434 req_id = 7bbbfec6-56bb-46a3-8219-abe520c53f56 response_code = 200 uri = /inventory
15892024-09-03T23:51:41.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15902024-09-03T23:51:41.727ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/omicron-zones.json file = common/src/ledger.rs:177
15912024-09-03T23:51:41.728ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/omicron-zones.json file = common/src/ledger.rs:177
15922024-09-03T23:51:41.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 953 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42434 req_id = ae3d0f47-1a54-4755-9619-f9600745aaef response_code = 200 uri = /omicron-zones
15932024-09-03T23:51:42.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64233
15942024-09-03T23:51:42.871ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15952024-09-03T23:51:42.872ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15962024-09-03T23:51:42.872ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
15972024-09-03T23:51:42.872ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15982024-09-03T23:51:42.872ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15992024-09-03T23:51:42.872ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16002024-09-03T23:51:42.872ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16012024-09-03T23:51:42.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64233 req_id = d9438f54-3ed7-4095-b211-23483aee9d05 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16022024-09-03T23:51:42.874ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:959
16032024-09-03T23:51:43.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40899
16042024-09-03T23:51:43.063ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16052024-09-03T23:51:43.063ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16062024-09-03T23:51:43.063ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
16072024-09-03T23:51:43.063ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16082024-09-03T23:51:43.063ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16092024-09-03T23:51:43.063ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16102024-09-03T23:51:43.063ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16112024-09-03T23:51:43.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40899 req_id = 5a3d6a22-b88c-471f-bc68-17fe7b3018dc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16122024-09-03T23:51:43.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59007
16132024-09-03T23:51:43.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16142024-09-03T23:51:43.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 85748 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59007 req_id = 7b7bd88a-ec50-4f98-8cad-5f5442f71fb8 response_code = 200 uri = /inventory
16152024-09-03T23:51:43.164ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16162024-09-03T23:51:43.164ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/config/omicron-zones.json file = common/src/ledger.rs:177
16172024-09-03T23:51:43.165ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/287d8187-80e6-478c-877b-4a09970caed2/config/omicron-zones.json file = common/src/ledger.rs:177
16182024-09-03T23:51:43.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 902 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59007 req_id = 9e4fb7f4-ee20-47b7-b855-9b9ecb561d4c response_code = 200 uri = /omicron-zones
16192024-09-03T23:51:43.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47134
16202024-09-03T23:51:43.491ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16212024-09-03T23:51:43.491ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16222024-09-03T23:51:43.491ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
16232024-09-03T23:51:43.491ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16242024-09-03T23:51:43.491ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16252024-09-03T23:51:43.491ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16262024-09-03T23:51:43.491ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16272024-09-03T23:51:43.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 693 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47134 req_id = 72ebdf98-cb34-4ac2-a1a4-b8414f431194 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16282024-09-03T23:51:44.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54011
16292024-09-03T23:51:44.191ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16302024-09-03T23:51:44.191ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16312024-09-03T23:51:44.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
16322024-09-03T23:51:44.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16332024-09-03T23:51:44.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16342024-09-03T23:51:44.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16352024-09-03T23:51:44.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16362024-09-03T23:51:44.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1011 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54011 req_id = 659bb9e7-b79a-414d-9ab9-3b57c9ff0f41 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16372024-09-03T23:51:49.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58934
16382024-09-03T23:51:49.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1586 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58934 req_id = a4d2beff-62ef-4431-b94a-9c4f3a8211fc response_code = 200 uri = /vpc-routes
16392024-09-03T23:51:49.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2021 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58934 req_id = 9dc0322e-9d0a-4274-b4cf-219f06de2887 response_code = 204 uri = /vpc-routes
16402024-09-03T23:51:52.153ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59905
16412024-09-03T23:51:52.153ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59905 req_id = c335e44f-4870-43df-bd23-e9f86ea3e2b5 response_code = 200 uri = /baseboard
16422024-09-03T23:52:09.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54520
16432024-09-03T23:52:09.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54520 req_id = bd5b4aa1-7ea6-455b-aec5-20c02ab27ab3 response_code = 200 uri = /vpc-routes
16442024-09-03T23:52:09.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54520 req_id = c1667397-79f5-495d-90ef-9357bbc2fbc8 response_code = 204 uri = /vpc-routes
16452024-09-03T23:52:09.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64472
16462024-09-03T23:52:09.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64472 req_id = fdb5dafb-ae29-4fcd-a101-7d02c9aed00a response_code = 200 uri = /vpc-routes
16472024-09-03T23:52:09.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64472 req_id = 288cfa93-8f78-4daa-ab66-b40bf08ca6c7 response_code = 204 uri = /vpc-routes
16482024-09-03T23:52:09.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55910
16492024-09-03T23:52:09.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1408 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55910 req_id = 544d1223-86de-4db2-8d5b-aa36ddeb03b8 response_code = 200 uri = /v2p
16502024-09-03T23:52:09.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40878
16512024-09-03T23:52:09.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40878 req_id = 4c39b7ea-02b1-4fd5-8680-7948b2d130da response_code = 200 uri = /v2p
16522024-09-03T23:52:09.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61240
16532024-09-03T23:52:09.514ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
16542024-09-03T23:52:09.590ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
16552024-09-03T23:52:09.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 139455 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61240 req_id = e379531c-9017-4790-ae98-d017df034945 response_code = 204 uri = /switch-ports
16562024-09-03T23:52:09.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42664
16572024-09-03T23:52:09.654ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
16582024-09-03T23:52:09.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4829 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61240 req_id = c449d054-c9f3-4770-bd10-fe9f918ec82a response_code = 200 uri = /network-bootstore-config
16592024-09-03T23:52:09.695ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
16602024-09-03T23:52:09.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101934 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42664 req_id = 8a02861e-7892-4354-ade7-21c74da0a2e2 response_code = 204 uri = /switch-ports
16612024-09-03T23:52:09.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42664 req_id = d8c43b33-7a2e-4ded-897d-592de19b3c34 response_code = 200 uri = /network-bootstore-config
16622024-09-03T23:52:09.804ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
16632024-09-03T23:52:09.806ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16642024-09-03T23:52:09.808ZINFOSledAgent (bootstore): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16652024-09-03T23:52:09.809ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
16662024-09-03T23:52:09.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61240 req_id = 552d9537-3106-49c4-aad2-dfa487d14776 response_code = 204 uri = /network-bootstore-config
16672024-09-03T23:52:09.814ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
16682024-09-03T23:52:09.814ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16692024-09-03T23:52:09.814ZINFOSledAgent (bootstore): Writing ledger to /pool/int/287d8187-80e6-478c-877b-4a09970caed2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16702024-09-03T23:52:09.814ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
16712024-09-03T23:52:09.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 558 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42664 req_id = 637be126-b885-4245-961e-006e3748878d response_code = 204 uri = /network-bootstore-config
16722024-09-03T23:52:10.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57573
16732024-09-03T23:52:10.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57573 req_id = d313ec66-4eb7-4bec-8c9f-1874891dfb67 response_code = 200 uri = /vpc-routes
16742024-09-03T23:52:10.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 942 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57573 req_id = 72a4b34d-5f81-4ecc-abc7-25d07a98d5a1 response_code = 204 uri = /vpc-routes
16752024-09-03T23:52:10.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48582
16762024-09-03T23:52:10.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48582 req_id = 9403134d-5f59-43fe-8b18-65b373ad3279 response_code = 200 uri = /v2p
16772024-09-03T23:52:10.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56579
16782024-09-03T23:52:10.270ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
16792024-09-03T23:52:10.305ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
16802024-09-03T23:52:10.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 87854 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56579 req_id = d2c9447d-a055-45af-b677-83a22b66be6d response_code = 204 uri = /switch-ports
16812024-09-03T23:52:10.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56579 req_id = e70778c2-d319-4d30-9785-212de0e4ca3a response_code = 200 uri = /network-bootstore-config
16822024-09-03T23:52:21.951ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:34608 remote_addr = [fd00:1122:3344:101::d]:45913 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
16832024-09-03T23:52:21.993ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42252 local_addr = [fd00:1122:3344:101::1]:34608 method = GET remote_addr = [fd00:1122:3344:101::d]:45913 req_id = af982485-cbbc-465e-9113-f65edfdbf8e3 response_code = 200 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a uri = /b281022b-35b2-452e-ad2b-78e12f6ca16a
16842024-09-03T23:52:22.188ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51537
16852024-09-03T23:52:22.188ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51537 req_id = a422ec68-cd24-48d0-a6c8-13ab602dc4c1 response_code = 200 uri = /baseboard
16862024-09-03T23:52:39.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39372
16872024-09-03T23:52:39.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39372 req_id = f325bb8e-9d7a-44e1-ba2d-30a5038b2539 response_code = 200 uri = /vpc-routes
16882024-09-03T23:52:39.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39372 req_id = b4b2616e-ecfe-4311-ac78-61600a731fbc response_code = 204 uri = /vpc-routes
16892024-09-03T23:52:39.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56624
16902024-09-03T23:52:39.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56624 req_id = 2f5c62e9-4472-4556-aea6-de8bbd2a2c6d response_code = 200 uri = /vpc-routes
16912024-09-03T23:52:39.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56624 req_id = ff0da9a0-cc39-4c3b-adde-d14a3efc9fd8 response_code = 204 uri = /vpc-routes
16922024-09-03T23:52:39.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52356
16932024-09-03T23:52:39.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52356 req_id = 4670e6e8-64fd-482e-8c9b-c741e17ea797 response_code = 200 uri = /v2p
16942024-09-03T23:52:39.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32861
16952024-09-03T23:52:39.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32861 req_id = 3da5c734-c578-4541-9d9f-515c1f9de6be response_code = 200 uri = /v2p
16962024-09-03T23:52:39.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35150
16972024-09-03T23:52:39.766ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
16982024-09-03T23:52:39.820ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
16992024-09-03T23:52:39.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 127935 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35150 req_id = ccbc83a2-e840-43ae-9fde-2177860d8b6e response_code = 204 uri = /switch-ports
17002024-09-03T23:52:39.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58593
17012024-09-03T23:52:39.894ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
17022024-09-03T23:52:39.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 374 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35150 req_id = 2a2793b0-b808-40db-b8f5-eaab5c50b8e7 response_code = 200 uri = /network-bootstore-config
17032024-09-03T23:52:39.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41456
17042024-09-03T23:52:39.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41456 req_id = a873585e-0b64-4d00-8b39-f7edfc5f1050 response_code = 200 uri = /vpc-routes
17052024-09-03T23:52:39.938ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
17062024-09-03T23:52:39.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41456 req_id = 951ae480-d071-4897-aa78-94a4bdb5dc3a response_code = 204 uri = /vpc-routes
17072024-09-03T23:52:39.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 102806 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58593 req_id = bf56f741-1ee2-4e86-9f7b-5d9eb5526fc0 response_code = 204 uri = /switch-ports
17082024-09-03T23:52:39.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58593 req_id = 18db0aff-6b70-45bb-a0b2-cf384fdeb2ec response_code = 200 uri = /network-bootstore-config
17092024-09-03T23:52:40.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56559
17102024-09-03T23:52:40.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56559 req_id = dda266a7-09dc-4dc5-a7b3-39c4273ad2b6 response_code = 200 uri = /v2p
17112024-09-03T23:52:40.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41279
17122024-09-03T23:52:40.126ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
17132024-09-03T23:52:40.164ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
17142024-09-03T23:52:40.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91516 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41279 req_id = 1ccba91f-d760-4ce9-9ece-8450eb4df950 response_code = 204 uri = /switch-ports
17152024-09-03T23:52:40.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41279 req_id = 19cc54ea-dfed-4597-86f6-3c53dfa3f2f1 response_code = 200 uri = /network-bootstore-config
17162024-09-03T23:52:51.959ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5798 local_addr = [fd00:1122:3344:101::1]:34608 method = GET remote_addr = [fd00:1122:3344:101::d]:45913 req_id = a61a8754-dd01-4e1c-bc96-4991fed6423e response_code = 200 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a uri = /b281022b-35b2-452e-ad2b-78e12f6ca16a
17172024-09-03T23:52:52.232ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51567
17182024-09-03T23:52:52.232ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51567 req_id = f7122493-3cff-42d9-93d8-12cad1159e06 response_code = 200 uri = /baseboard
17192024-09-03T23:53:09.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41414
17202024-09-03T23:53:09.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41414 req_id = c88add05-ded8-4a73-bb03-ba4f64c6326f response_code = 200 uri = /vpc-routes
17212024-09-03T23:53:09.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35844
17222024-09-03T23:53:09.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 868 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35844 req_id = e9ca4572-2405-432f-b3c2-5d631cd27ab5 response_code = 200 uri = /vpc-routes
17232024-09-03T23:53:09.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41414 req_id = fc78ae0f-3f81-4e32-876a-dac67634dcdb response_code = 204 uri = /vpc-routes
17242024-09-03T23:53:09.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59862
17252024-09-03T23:53:09.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59862 req_id = 52a30b48-0dca-4597-9f82-bc2e9f31615b response_code = 200 uri = /v2p
17262024-09-03T23:53:09.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35844 req_id = 278a9955-c9ff-42f6-96a5-8d44fc2ef3c7 response_code = 204 uri = /vpc-routes
17272024-09-03T23:53:09.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39848
17282024-09-03T23:53:09.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39848 req_id = 54fcafdf-30f5-460d-abe9-e22ad7658d20 response_code = 200 uri = /v2p
17292024-09-03T23:53:09.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38622
17302024-09-03T23:53:09.611ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
17312024-09-03T23:53:09.650ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
17322024-09-03T23:53:09.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93044 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38622 req_id = 8ad5342a-bc6f-43c2-b49b-85ac9b607af2 response_code = 204 uri = /switch-ports
17332024-09-03T23:53:09.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59026
17342024-09-03T23:53:09.704ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
17352024-09-03T23:53:09.737ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
17362024-09-03T23:53:09.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106040 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59026 req_id = 8936f657-d12d-4ae5-98f1-3097b8677000 response_code = 204 uri = /switch-ports
17372024-09-03T23:53:09.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38622 req_id = b9367967-3a94-4810-bb6c-05cc7c2c30b4 response_code = 200 uri = /network-bootstore-config
17382024-09-03T23:53:09.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59026 req_id = caa44849-49f7-42c0-a3f8-27511c013c10 response_code = 200 uri = /network-bootstore-config
17392024-09-03T23:53:10.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43767
17402024-09-03T23:53:10.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43767 req_id = 0a85bb20-bb4c-4f1e-9898-296369bf696b response_code = 200 uri = /v2p
17412024-09-03T23:53:10.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58659
17422024-09-03T23:53:10.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58659 req_id = d9f32a91-4648-42da-b1d5-949755a37fd1 response_code = 200 uri = /vpc-routes
17432024-09-03T23:53:10.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58659 req_id = be9dff4a-06f6-4875-8305-66b37de18b9c response_code = 204 uri = /vpc-routes
17442024-09-03T23:53:10.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54655
17452024-09-03T23:53:10.165ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
17462024-09-03T23:53:10.203ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
17472024-09-03T23:53:10.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54655 req_id = 54fe393a-7379-4916-a300-efb6ca8c5c7c response_code = 204 uri = /switch-ports
17482024-09-03T23:53:10.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54655 req_id = 74035273-a7de-41b4-acaa-2b58f4236e67 response_code = 200 uri = /network-bootstore-config
17492024-09-03T23:53:14.763ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
17502024-09-03T23:53:21.957ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5742 local_addr = [fd00:1122:3344:101::1]:34608 method = GET remote_addr = [fd00:1122:3344:101::d]:45913 req_id = 61d773a6-59f3-444d-a3a4-bc532c1c292c response_code = 200 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a uri = /b281022b-35b2-452e-ad2b-78e12f6ca16a
17512024-09-03T23:53:22.276ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42704
17522024-09-03T23:53:22.276ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42704 req_id = 2be3a889-40e1-4f57-95be-c25dafb75c8e response_code = 200 uri = /baseboard
17532024-09-03T23:53:39.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39006
17542024-09-03T23:53:39.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39006 req_id = 42417625-c19c-4fc2-bf13-a35451f6e322 response_code = 200 uri = /vpc-routes
17552024-09-03T23:53:39.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39006 req_id = 842f3b4e-45b9-475e-a62c-346d4c405ba7 response_code = 204 uri = /vpc-routes
17562024-09-03T23:53:39.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33761
17572024-09-03T23:53:39.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33761 req_id = ca1fc0b9-5c63-4fcb-b281-39fc5aa04baf response_code = 200 uri = /v2p
17582024-09-03T23:53:39.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52578
17592024-09-03T23:53:39.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52578 req_id = 6dccc895-3de5-4d80-98c0-9c494fe2589e response_code = 200 uri = /vpc-routes
17602024-09-03T23:53:39.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52578 req_id = 19d9d054-e562-4b65-b0fe-a304707a8347 response_code = 204 uri = /vpc-routes
17612024-09-03T23:53:39.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43511
17622024-09-03T23:53:39.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43511 req_id = d84ccd7c-f9f7-4db1-9c94-3a7a0906017a response_code = 200 uri = /v2p
17632024-09-03T23:53:39.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56978
17642024-09-03T23:53:39.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
17652024-09-03T23:53:39.884ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
17662024-09-03T23:53:39.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98149 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56978 req_id = 1937d723-b055-4b70-9052-6e2bef9ef038 response_code = 204 uri = /switch-ports
17672024-09-03T23:53:39.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62463
17682024-09-03T23:53:39.943ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
17692024-09-03T23:53:39.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56978 req_id = 75112d42-c1e2-4077-b7d3-05dbc06a2b39 response_code = 200 uri = /network-bootstore-config
17702024-09-03T23:53:39.983ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
17712024-09-03T23:53:40.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40125
17722024-09-03T23:53:40.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40125 req_id = d62eebda-1e54-46c7-b881-6d4fef183cd7 response_code = 200 uri = /v2p
17732024-09-03T23:53:40.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62463 req_id = 214151d6-0cd9-4e87-a9de-47980f577a9c response_code = 204 uri = /switch-ports
17742024-09-03T23:53:40.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62463 req_id = 5a9b5aaa-b7ab-4657-87f1-3f2aa1e0f7de response_code = 200 uri = /network-bootstore-config
17752024-09-03T23:53:40.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64611
17762024-09-03T23:53:40.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64611 req_id = 80150f14-385a-4835-ba9f-7a8e30899090 response_code = 200 uri = /vpc-routes
17772024-09-03T23:53:40.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64611 req_id = 355803da-1e50-43aa-99e0-9c373b26360b response_code = 204 uri = /vpc-routes
17782024-09-03T23:53:40.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49585
17792024-09-03T23:53:40.255ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
17802024-09-03T23:53:40.290ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
17812024-09-03T23:53:40.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89021 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49585 req_id = 75ba1253-5124-444c-a413-20a1eb1752d8 response_code = 204 uri = /switch-ports
17822024-09-03T23:53:40.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 675 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49585 req_id = d48b3953-5f0d-4b5d-90a4-53b2e443499f response_code = 200 uri = /network-bootstore-config
17832024-09-03T23:53:51.957ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5672 local_addr = [fd00:1122:3344:101::1]:34608 method = GET remote_addr = [fd00:1122:3344:101::d]:45913 req_id = 7ca8f0fb-6353-4482-be63-3e6bff6559c4 response_code = 200 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a uri = /b281022b-35b2-452e-ad2b-78e12f6ca16a
17842024-09-03T23:53:52.308ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58588
17852024-09-03T23:53:52.308ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58588 req_id = 783882b7-d817-4217-afa0-31c4c48735e1 response_code = 200 uri = /baseboard
17862024-09-03T23:54:09.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60644
17872024-09-03T23:54:09.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60644 req_id = 0bb67007-16b5-45f7-87cf-b9feb915e410 response_code = 200 uri = /vpc-routes
17882024-09-03T23:54:09.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54881
17892024-09-03T23:54:09.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54881 req_id = 21485db5-c791-4b9f-8014-035f2be8ffa9 response_code = 200 uri = /vpc-routes
17902024-09-03T23:54:09.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 769 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54881 req_id = 7976ef93-10cf-46ca-adca-cb453ca2659e response_code = 204 uri = /vpc-routes
17912024-09-03T23:54:09.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43277
17922024-09-03T23:54:09.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43277 req_id = eaa8d62c-cd51-458d-b936-4f4e3fd327ca response_code = 200 uri = /v2p
17932024-09-03T23:54:09.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60644 req_id = ddce447e-6b66-4e90-969b-5f6a8161f61d response_code = 204 uri = /vpc-routes
17942024-09-03T23:54:09.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43042
17952024-09-03T23:54:09.622ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
17962024-09-03T23:54:09.661ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
17972024-09-03T23:54:09.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95405 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43042 req_id = e037ef35-962a-40bf-8dcd-f226f463f03c response_code = 204 uri = /switch-ports
17982024-09-03T23:54:09.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47093
17992024-09-03T23:54:09.718ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
18002024-09-03T23:54:09.757ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
18012024-09-03T23:54:09.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 112182 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47093 req_id = 69fd05fe-5eda-45f9-aed6-099ccf26cce3 response_code = 204 uri = /switch-ports
18022024-09-03T23:54:09.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52245
18032024-09-03T23:54:09.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43042 req_id = 76d6113b-ec3c-474a-8417-399eee2f1160 response_code = 200 uri = /network-bootstore-config
18042024-09-03T23:54:09.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1070 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47093 req_id = e1dd5f34-3615-4ecc-8a57-5a22b735a033 response_code = 200 uri = /network-bootstore-config
18052024-09-03T23:54:09.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1019 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52245 req_id = c152b807-75b0-45f3-81be-ba2e8456889c response_code = 200 uri = /v2p
18062024-09-03T23:54:09.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42238
18072024-09-03T23:54:09.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42238 req_id = e54b3354-ad96-4526-b915-a005fcdea6cc response_code = 200 uri = /vpc-routes
18082024-09-03T23:54:09.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65258
18092024-09-03T23:54:09.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65258 req_id = 34c31583-8c5c-4449-aa27-273453a4e767 response_code = 200 uri = /v2p
18102024-09-03T23:54:10.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42238 req_id = 5b714c8d-296f-447e-bbc5-cfdc4405e204 response_code = 204 uri = /vpc-routes
18112024-09-03T23:54:10.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46449
18122024-09-03T23:54:10.255ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
18132024-09-03T23:54:10.293ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
18142024-09-03T23:54:10.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90871 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46449 req_id = cd3cb621-cbd0-4bd4-9064-207a65a51961 response_code = 204 uri = /switch-ports
18152024-09-03T23:54:10.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46449 req_id = a4392f63-c667-40a0-9abb-dcc9815c90f5 response_code = 200 uri = /network-bootstore-config
18162024-09-03T23:54:21.968ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6786 local_addr = [fd00:1122:3344:101::1]:34608 method = GET remote_addr = [fd00:1122:3344:101::d]:45913 req_id = 7887dc5b-718a-40f5-a34a-cbefeeda2560 response_code = 200 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a uri = /b281022b-35b2-452e-ad2b-78e12f6ca16a
18172024-09-03T23:54:22.341ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47990
18182024-09-03T23:54:22.341ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47990 req_id = aa089b05-fa54-474b-8613-ec24cfcdc314 response_code = 200 uri = /baseboard
18192024-09-03T23:54:39.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47334
18202024-09-03T23:54:39.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47334 req_id = ab4cffd0-860d-4f62-93b0-91ab54b54663 response_code = 200 uri = /vpc-routes
18212024-09-03T23:54:39.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1561 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47334 req_id = ce87f89d-4ce5-498b-9eef-31c27bdc3034 response_code = 204 uri = /vpc-routes
18222024-09-03T23:54:39.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56258
18232024-09-03T23:54:39.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56258 req_id = 1451079a-a4c8-4003-902b-9dde9fcf0037 response_code = 200 uri = /v2p
18242024-09-03T23:54:39.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42797
18252024-09-03T23:54:39.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42797 req_id = 31e2469a-1c2f-4cfb-82f2-7b836dbd56c8 response_code = 200 uri = /vpc-routes
18262024-09-03T23:54:39.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42797 req_id = 3a45dd6e-c562-48e2-95cb-9866ce32c7ac response_code = 204 uri = /vpc-routes
18272024-09-03T23:54:39.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42279
18282024-09-03T23:54:39.817ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
18292024-09-03T23:54:39.860ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
18302024-09-03T23:54:39.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106599 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42279 req_id = 1a1ec711-0e6f-43fc-a833-595efcee74ab response_code = 204 uri = /switch-ports
18312024-09-03T23:54:39.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63507
18322024-09-03T23:54:39.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61148
18332024-09-03T23:54:39.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63507 req_id = 420724db-8542-4f9c-b4a1-96e4cf467e8f response_code = 200 uri = /v2p
18342024-09-03T23:54:39.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42279 req_id = 2eb72327-2b95-4989-b45b-c4b005f3cb42 response_code = 200 uri = /network-bootstore-config
18352024-09-03T23:54:39.924ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
18362024-09-03T23:54:39.965ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
18372024-09-03T23:54:40.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97667 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61148 req_id = f9c8e741-6cfc-4675-8667-c4650e47f752 response_code = 204 uri = /switch-ports
18382024-09-03T23:54:40.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 904 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61148 req_id = 05a0aa7f-7d36-42ae-999b-daa030fee7d2 response_code = 200 uri = /network-bootstore-config
18392024-09-03T23:54:40.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57219
18402024-09-03T23:54:40.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57219 req_id = e14d2396-d6da-4f1e-b0bc-d98ac3a02170 response_code = 200 uri = /vpc-routes
18412024-09-03T23:54:40.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42999
18422024-09-03T23:54:40.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42999 req_id = 83f87c93-e349-4ff3-b415-ba876531d4fb response_code = 200 uri = /v2p
18432024-09-03T23:54:40.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57219 req_id = d4d97ae9-c14e-4145-ae4d-469d65ce56e3 response_code = 204 uri = /vpc-routes
18442024-09-03T23:54:40.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57466
18452024-09-03T23:54:40.410ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
18462024-09-03T23:54:40.449ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
18472024-09-03T23:54:40.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95769 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57466 req_id = 7f06892b-ccbd-4e4d-a1a3-8b63524f4cbe response_code = 204 uri = /switch-ports
18482024-09-03T23:54:40.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57466 req_id = 573fb70d-279c-4d48-ac73-00f8e7b379ad response_code = 200 uri = /network-bootstore-config
18492024-09-03T23:54:52.029ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6714 local_addr = [fd00:1122:3344:101::1]:34608 method = GET remote_addr = [fd00:1122:3344:101::d]:45913 req_id = 2ac92c7a-aab5-42c4-8bad-6413e9f5a400 response_code = 200 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a uri = /b281022b-35b2-452e-ad2b-78e12f6ca16a
18502024-09-03T23:54:52.375ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43853
18512024-09-03T23:54:52.375ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43853 req_id = 1d509fbe-510b-4a00-bcf6-ecc0da280518 response_code = 200 uri = /baseboard
18522024-09-03T23:55:09.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55747
18532024-09-03T23:55:09.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55747 req_id = f57db238-e073-4984-ad63-ecd9f2f67bc5 response_code = 200 uri = /vpc-routes
18542024-09-03T23:55:09.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56910
18552024-09-03T23:55:09.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56910 req_id = 881fbf43-950d-4415-bf57-61223362d0e7 response_code = 200 uri = /vpc-routes
18562024-09-03T23:55:09.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45514
18572024-09-03T23:55:09.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45514 req_id = 46fbc67a-343f-4737-afdd-ec86dc4e52b5 response_code = 200 uri = /v2p
18582024-09-03T23:55:09.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49263
18592024-09-03T23:55:09.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49263 req_id = b2c24f97-f85f-492d-9391-c8246853aa59 response_code = 200 uri = /v2p
18602024-09-03T23:55:09.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49171
18612024-09-03T23:55:09.545ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
18622024-09-03T23:55:09.583ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
18632024-09-03T23:55:09.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49171 req_id = 2bf122ab-5442-4cc6-a3a9-a2b8f500e321 response_code = 204 uri = /switch-ports
18642024-09-03T23:55:09.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48004
18652024-09-03T23:55:09.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49171 req_id = e48dccc5-1f3d-49cf-b022-7f126e730ad7 response_code = 200 uri = /network-bootstore-config
18662024-09-03T23:55:09.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55747 req_id = 68b4a239-c8c3-45d6-8596-9251a4996430 response_code = 204 uri = /vpc-routes
18672024-09-03T23:55:09.643ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
18682024-09-03T23:55:09.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 828 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56910 req_id = 5c0a4619-18fb-4b5e-a03b-12500cab94fd response_code = 204 uri = /vpc-routes
18692024-09-03T23:55:09.683ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
18702024-09-03T23:55:09.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92527 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48004 req_id = 73a9e147-2279-4e7e-9dd1-578c6610f2dd response_code = 204 uri = /switch-ports
18712024-09-03T23:55:09.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48004 req_id = 5807d6c0-7263-4422-b6cf-f133104adb26 response_code = 200 uri = /network-bootstore-config
18722024-09-03T23:55:09.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54091
18732024-09-03T23:55:09.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54091 req_id = 392c8c7f-050a-4916-93a9-609a3f5a9f09 response_code = 200 uri = /vpc-routes
18742024-09-03T23:55:09.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54091 req_id = a78c40bb-7a69-4684-9060-ffe61438ca94 response_code = 204 uri = /vpc-routes
18752024-09-03T23:55:10.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34936
18762024-09-03T23:55:10.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34936 req_id = 6cdebd4f-8d53-4eb9-85db-0f01760eac22 response_code = 200 uri = /v2p
18772024-09-03T23:55:10.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59980
18782024-09-03T23:55:10.032ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
18792024-09-03T23:55:10.069ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
18802024-09-03T23:55:10.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91157 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59980 req_id = a6c28466-0151-4bff-affb-60f55c45a108 response_code = 204 uri = /switch-ports
18812024-09-03T23:55:10.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59980 req_id = a20b7579-7c94-43e6-aafb-b18fb18edb3b response_code = 200 uri = /network-bootstore-config
18822024-09-03T23:55:22.029ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6968 local_addr = [fd00:1122:3344:101::1]:34608 method = GET remote_addr = [fd00:1122:3344:101::d]:45913 req_id = de8a299e-3a51-41d5-80e8-819ac92f2ac9 response_code = 200 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a uri = /b281022b-35b2-452e-ad2b-78e12f6ca16a
18832024-09-03T23:55:22.408ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65048
18842024-09-03T23:55:22.408ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 115 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65048 req_id = 651e444f-ddb7-4319-a3ba-3d6fb1239320 response_code = 200 uri = /baseboard
18852024-09-03T23:55:39.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45547
18862024-09-03T23:55:39.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45547 req_id = 7ec69f12-3bb3-4841-a506-fd761147346e response_code = 200 uri = /vpc-routes
18872024-09-03T23:55:39.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45547 req_id = ea57b263-afb5-4f95-a74f-fa616496c135 response_code = 204 uri = /vpc-routes
18882024-09-03T23:55:39.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38291
18892024-09-03T23:55:39.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38291 req_id = cdfb3a66-2ae6-471a-b6c7-4164e9404d30 response_code = 200 uri = /vpc-routes
18902024-09-03T23:55:39.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41895
18912024-09-03T23:55:39.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41895 req_id = 497c861c-c039-4e90-be2a-c357353bbbdb response_code = 200 uri = /v2p
18922024-09-03T23:55:39.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46426
18932024-09-03T23:55:39.693ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
18942024-09-03T23:55:39.732ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
18952024-09-03T23:55:39.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 129652 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46426 req_id = aab2eb4a-f372-46a2-adb9-62ac098e94a1 response_code = 204 uri = /switch-ports
18962024-09-03T23:55:39.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42822
18972024-09-03T23:55:39.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38291 req_id = c7de1b7a-14cf-4df6-9ea8-65273fdb5222 response_code = 204 uri = /vpc-routes
18982024-09-03T23:55:39.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46426 req_id = 5cb71176-a630-4af7-85a8-98d4d78b70a2 response_code = 200 uri = /network-bootstore-config
18992024-09-03T23:55:39.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42822 req_id = f210465f-171e-4e7a-be36-7b4b99f22776 response_code = 200 uri = /v2p
19002024-09-03T23:55:39.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33324
19012024-09-03T23:55:39.983ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
19022024-09-03T23:55:40.023ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
19032024-09-03T23:55:40.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97498 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33324 req_id = 4c198b02-2959-45e8-bd18-35ad35384d40 response_code = 204 uri = /switch-ports
19042024-09-03T23:55:40.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33324 req_id = 305745c9-f01a-45b0-b60d-0a03ccb4dcbb response_code = 200 uri = /network-bootstore-config
19052024-09-03T23:55:40.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47979
19062024-09-03T23:55:40.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 693 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47979 req_id = fa52c87d-08d6-4f2d-a088-51c6f0e40dbd response_code = 200 uri = /vpc-routes
19072024-09-03T23:55:40.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47979 req_id = f93961ac-a4da-4b50-8a27-0c9b4cff6aac response_code = 204 uri = /vpc-routes
19082024-09-03T23:55:40.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55423
19092024-09-03T23:55:40.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55423 req_id = 13ac89a9-00e8-4232-ab5e-1112c6827570 response_code = 200 uri = /v2p
19102024-09-03T23:55:40.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59041
19112024-09-03T23:55:40.425ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
19122024-09-03T23:55:40.460ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
19132024-09-03T23:55:40.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91467 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59041 req_id = 13eb161f-744a-4681-80ef-88af19f53600 response_code = 204 uri = /switch-ports
19142024-09-03T23:55:40.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59041 req_id = 03aa1111-bced-4618-85aa-ac1c9de3301e response_code = 200 uri = /network-bootstore-config
19152024-09-03T23:55:52.029ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6754 local_addr = [fd00:1122:3344:101::1]:34608 method = GET remote_addr = [fd00:1122:3344:101::d]:45913 req_id = 5f73a51c-34f7-4e03-b0d0-2257fae2521c response_code = 200 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a uri = /b281022b-35b2-452e-ad2b-78e12f6ca16a
19162024-09-03T23:55:52.440ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57026
19172024-09-03T23:55:52.440ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57026 req_id = 55b45cf7-5067-4c80-88b6-9db13fbc0c62 response_code = 200 uri = /baseboard
19182024-09-03T23:56:09.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42139
19192024-09-03T23:56:09.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42139 req_id = 6f627197-1504-444a-91a3-d5ba887e074a response_code = 200 uri = /vpc-routes
19202024-09-03T23:56:09.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42139 req_id = bce0ba93-5f50-4337-bf31-16ec6e1f568b response_code = 204 uri = /vpc-routes
19212024-09-03T23:56:09.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58180
19222024-09-03T23:56:09.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58180 req_id = 3e3a1a46-86d5-40cc-a808-86dae6e79b1c response_code = 200 uri = /v2p
19232024-09-03T23:56:09.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48590
19242024-09-03T23:56:09.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48590 req_id = f0aa8562-cdba-47e5-accb-50d07de7ea50 response_code = 200 uri = /vpc-routes
19252024-09-03T23:56:09.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48590 req_id = b85a2e66-35ec-4c44-a30a-4f1696bf0023 response_code = 204 uri = /vpc-routes
19262024-09-03T23:56:09.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51976
19272024-09-03T23:56:09.593ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
19282024-09-03T23:56:09.628ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
19292024-09-03T23:56:09.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 87911 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51976 req_id = 35ecf048-24be-4d6b-8bd4-d97b82cf4de3 response_code = 204 uri = /switch-ports
19302024-09-03T23:56:09.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58443
19312024-09-03T23:56:09.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58443 req_id = 8d8df06d-2613-408c-b745-376265429e29 response_code = 200 uri = /v2p
19322024-09-03T23:56:09.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51976 req_id = 670dde56-70af-446a-84a0-cf5c47ca9802 response_code = 200 uri = /network-bootstore-config
19332024-09-03T23:56:09.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35244
19342024-09-03T23:56:09.687ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
19352024-09-03T23:56:09.723ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
19362024-09-03T23:56:09.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110383 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35244 req_id = 1971a4b0-fdad-4a8f-aae1-44251e43bb8d response_code = 204 uri = /switch-ports
19372024-09-03T23:56:09.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35244 req_id = d89ee0ae-d594-49f8-a3b6-21410b153965 response_code = 200 uri = /network-bootstore-config
19382024-09-03T23:56:10.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45510
19392024-09-03T23:56:10.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45510 req_id = c4f09f6e-281f-49c9-ad91-f2431d582656 response_code = 200 uri = /vpc-routes
19402024-09-03T23:56:10.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41222
19412024-09-03T23:56:10.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41222 req_id = ceb5dda2-4650-4d3d-b4db-022ba0ce5e0f response_code = 200 uri = /v2p
19422024-09-03T23:56:10.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45510 req_id = e0897d03-e1a1-43dd-a1fd-f054d79a8929 response_code = 204 uri = /vpc-routes
19432024-09-03T23:56:10.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34705
19442024-09-03T23:56:10.120ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
19452024-09-03T23:56:10.158ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
19462024-09-03T23:56:10.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91624 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34705 req_id = 736cc6e3-f04d-4d64-9af2-4591ed4663c0 response_code = 204 uri = /switch-ports
19472024-09-03T23:56:10.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34705 req_id = 8efe0805-9256-49a1-97c4-177654b47f18 response_code = 200 uri = /network-bootstore-config
19482024-09-03T23:56:22.029ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5767 local_addr = [fd00:1122:3344:101::1]:34608 method = GET remote_addr = [fd00:1122:3344:101::d]:45913 req_id = 63b832c3-b9ea-471e-908e-9b6f5f841c06 response_code = 200 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a uri = /b281022b-35b2-452e-ad2b-78e12f6ca16a
19492024-09-03T23:56:22.473ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38366
19502024-09-03T23:56:22.473ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38366 req_id = 2f8b3b48-86be-4dfc-a688-9de8faad0f0f response_code = 200 uri = /baseboard
19512024-09-03T23:56:39.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61112
19522024-09-03T23:56:39.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61112 req_id = c755e4d9-bd16-492a-81d8-1dc732ab1938 response_code = 200 uri = /vpc-routes
19532024-09-03T23:56:39.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61112 req_id = 0c54a538-22a1-46fc-8c09-fd94dd4e64c5 response_code = 204 uri = /vpc-routes
19542024-09-03T23:56:39.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60074
19552024-09-03T23:56:39.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60074 req_id = fb889367-0859-4f56-a27e-b969ffa9ace7 response_code = 200 uri = /v2p
19562024-09-03T23:56:39.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59894
19572024-09-03T23:56:39.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59894 req_id = 38f17599-2a96-47c6-af46-8a934e2bec9f response_code = 200 uri = /vpc-routes
19582024-09-03T23:56:39.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56429
19592024-09-03T23:56:39.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56429 req_id = e2b3b9f5-6d74-475d-b8ba-1c1805709684 response_code = 200 uri = /v2p
19602024-09-03T23:56:39.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59894 req_id = 725d044b-3188-4300-ad8d-5003f85badb5 response_code = 204 uri = /vpc-routes
19612024-09-03T23:56:39.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60456
19622024-09-03T23:56:39.860ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
19632024-09-03T23:56:39.903ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
19642024-09-03T23:56:39.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100844 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60456 req_id = ee313ac3-ed66-4668-9fd2-ef39a64b90c1 response_code = 204 uri = /switch-ports
19652024-09-03T23:56:39.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36074
19662024-09-03T23:56:39.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35166
19672024-09-03T23:56:39.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35166 req_id = 9a9c6c82-24d4-4434-8049-78d795ca718a response_code = 200 uri = /vpc-routes
19682024-09-03T23:56:39.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 382 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60456 req_id = 8c04498e-1594-4aed-9c50-8894f02e1c9f response_code = 200 uri = /network-bootstore-config
19692024-09-03T23:56:39.962ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19702024-09-03T23:56:39.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19712024-09-03T23:56:39.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
19722024-09-03T23:56:39.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19732024-09-03T23:56:39.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19742024-09-03T23:56:39.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19752024-09-03T23:56:39.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19762024-09-03T23:56:39.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 443 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36074 req_id = 128810d6-dff9-422f-87bc-d62d2e35ab84 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19772024-09-03T23:56:40.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64193
19782024-09-03T23:56:40.001ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19792024-09-03T23:56:40.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19802024-09-03T23:56:40.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
19812024-09-03T23:56:40.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19822024-09-03T23:56:40.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19832024-09-03T23:56:40.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19842024-09-03T23:56:40.001ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19852024-09-03T23:56:40.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64193 req_id = 196b470a-1052-4664-9c03-87d651082f73 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19862024-09-03T23:56:40.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37742
19872024-09-03T23:56:40.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1057 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37742 req_id = 0996e6f8-60ac-4713-9a68-bd62a59a9dbb response_code = 200 uri = /v2p
19882024-09-03T23:56:40.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 848 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35166 req_id = e42f2d7c-bc6e-44a6-bc44-891b762cc1d1 response_code = 204 uri = /vpc-routes
19892024-09-03T23:56:40.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45430
19902024-09-03T23:56:40.121ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
19912024-09-03T23:56:40.161ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
19922024-09-03T23:56:40.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98374 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45430 req_id = da527890-df83-4bbd-97ef-6301592e6c65 response_code = 204 uri = /switch-ports
19932024-09-03T23:56:40.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45430 req_id = ece5cf83-d20f-41cc-a491-ff69c798572e response_code = 200 uri = /network-bootstore-config
19942024-09-03T23:56:40.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34945
19952024-09-03T23:56:40.223ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
19962024-09-03T23:56:40.262ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
19972024-09-03T23:56:40.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96315 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34945 req_id = 664f6ed1-18e1-4047-a028-d41daaefcc35 response_code = 204 uri = /switch-ports
19982024-09-03T23:56:40.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34945 req_id = 6a12a26d-c1df-4281-bb09-3855e5382c6d response_code = 200 uri = /network-bootstore-config
19992024-09-03T23:56:40.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41257
20002024-09-03T23:56:40.386ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 07996add-44ce-4253-be85-4745eb2604d5, kind: Service { id: 90a0c753-ce30-4bd3-a374-17c504cb8aee }, name: Name("external-dns-90a0c753-ce30-4bd3-a374-17c504cb8aee"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 716ed353-46fc-4036-8260-0f0a30a9b8c2, kind: Service { id: 1f2af9fb-1e02-483c-afd2-2b8742b46afd }, name: Name("external-dns-1f2af9fb-1e02-483c-afd2-2b8742b46afd"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 121])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2976bd07-76bd-4399-870b-d0394e02e2a3, kind: Service { id: 5a19fea2-ef2a-4710-a2dc-f909b9134850 }, name: Name("nexus-5a19fea2-ef2a-4710-a2dc-f909b9134850"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4c70480a-1678-45e9-b6dd-7c33aaf09ba7, kind: Service { id: 5f5ce676-2064-4d97-b873-fbcbc29495de }, name: Name("nexus-5f5ce676-2064-4d97-b873-fbcbc29495de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eca333f3-d503-438d-96c9-fdd58cc22e48, kind: Service { id: 6a103559-9ed4-4654-9b5e-18577b1b0579 }, name: Name("nexus-6a103559-9ed4-4654-9b5e-18577b1b0579"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 187])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20012024-09-03T23:56:40.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20022024-09-03T23:56:40.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
20032024-09-03T23:56:40.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20042024-09-03T23:56:40.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20052024-09-03T23:56:40.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20062024-09-03T23:56:40.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20072024-09-03T23:56:40.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 482 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41257 req_id = eb3638d6-4be1-47f2-94ff-4f1cde8af6c0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20082024-09-03T23:56:52.031ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7440 local_addr = [fd00:1122:3344:101::1]:34608 method = GET remote_addr = [fd00:1122:3344:101::d]:45913 req_id = af7603d3-c059-42c6-b2bd-522b9078a742 response_code = 200 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a uri = /b281022b-35b2-452e-ad2b-78e12f6ca16a
20092024-09-03T23:56:52.506ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64647
20102024-09-03T23:56:52.506ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64647 req_id = f1b0d1c1-3b75-491d-9840-09112ac8a075 response_code = 200 uri = /baseboard
20112024-09-03T23:57:05.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58000
20122024-09-03T23:57:05.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58000 req_id = 558ac7b4-b00d-4ebb-823d-e3a87aba8390 response_code = 200 uri = /v2p
20132024-09-03T23:57:05.775ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:778 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 254, 33, 139])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(14558931) }
20142024-09-03T23:57:05.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58000 req_id = 57876070-fff9-4d8e-b1bb-71fbd979e54e response_code = 204 uri = /v2p
20152024-09-03T23:57:05.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44318
20162024-09-03T23:57:05.894ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:570 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 595e6744-1ac7-47ec-a8a2-110fb628bd11, kind: Instance { id: 57689d15-57f5-498e-ba97-26ce1fb9565d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 33, 139])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14558931), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 595e6744-1ac7-47ec-a8a2-110fb628bd11, kind: Instance { id: 57689d15-57f5-498e-ba97-26ce1fb9565d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 33, 139])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14558931), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 595e6744-1ac7-47ec-a8a2-110fb628bd11, kind: Instance { id: 57689d15-57f5-498e-ba97-26ce1fb9565d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 33, 139])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14558931), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14558931))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 595e6744-1ac7-47ec-a8a2-110fb628bd11, kind: Instance { id: 57689d15-57f5-498e-ba97-26ce1fb9565d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 33, 139])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14558931), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-2618e7a4e4f", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 17ab4fa3-6d9f-4124-9121-bf97f03737ca, read_only_parent: Some(Volume { block_size: 512, id: 58813733-a9da-4935-90b5-a774add8ea17, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 067f1160-121e-4513-84ca-4538c1732806, key: Some("+nv1l5OWKiCWi/6aK78YQ5nZ0IOtPFqx4dMSeWgjR/c="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::15]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 17ab4fa3-6d9f-4124-9121-bf97f03737ca, key: Some("TwPdFpGeysrFeoMyIpj3/K6UrfaVfPFwjaDlJJMGBhc="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::1a]:19000"] } }] } }], cloud_init_bytes: Some(..) } instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d instance_runtime = InstanceRuntimeState { propolis_id: Some(48c3ff33-2c5c-416c-b826-70461a3d6db6 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-09-03T23:57:05.421375485Z } metadata = InstanceMetadata { silo_id: 8448d8a2-33e4-4746-ac02-db97b8df3ca4, project_id: d721a24b-8073-44fd-8adc-d541f64a7c20 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-09-03T23:57:05.882581376Z }
20172024-09-03T23:57:05.894ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:603 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20182024-09-03T23:57:05.894ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1008 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d migration_id = None propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 595e6744-1ac7-47ec-a8a2-110fb628bd11, kind: Instance { id: 57689d15-57f5-498e-ba97-26ce1fb9565d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 33, 139])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14558931), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 595e6744-1ac7-47ec-a8a2-110fb628bd11, kind: Instance { id: 57689d15-57f5-498e-ba97-26ce1fb9565d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 33, 139])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14558931), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 595e6744-1ac7-47ec-a8a2-110fb628bd11, kind: Instance { id: 57689d15-57f5-498e-ba97-26ce1fb9565d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 33, 139])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14558931), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14558931))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 595e6744-1ac7-47ec-a8a2-110fb628bd11, kind: Instance { id: 57689d15-57f5-498e-ba97-26ce1fb9565d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 33, 139])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14558931), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-2618e7a4e4f", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 17ab4fa3-6d9f-4124-9121-bf97f03737ca, read_only_parent: Some(Volume { block_size: 512, id: 58813733-a9da-4935-90b5-a774add8ea17, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 067f1160-121e-4513-84ca-4538c1732806, key: Some("+nv1l5OWKiCWi/6aK78YQ5nZ0IOtPFqx4dMSeWgjR/c="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::15]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 17ab4fa3-6d9f-4124-9121-bf97f03737ca, key: Some("TwPdFpGeysrFeoMyIpj3/K6UrfaVfPFwjaDlJJMGBhc="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::1a]:19000"] } }] } }], cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-09-03T23:57:05.882581376Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
20192024-09-03T23:57:05.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9496 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44318 req_id = a8c8f63a-e764-4ff0-b92a-a280d572671d response_code = 200 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6
20202024-09-03T23:57:05.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40017
20212024-09-03T23:57:05.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 840 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40017 req_id = 0f22e0c5-13fe-4679-a389-6bd2426b6210 response_code = 200 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6/state
20222024-09-03T23:57:05.988ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 254, 33, 139]), slot: 0, vni: Vni { inner: 14558931 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
20232024-09-03T23:57:05.988ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
20242024-09-03T23:57:06.030ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6 file = illumos-utils/src/zone.rs:316 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20252024-09-03T23:57:06.052ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6 file = illumos-utils/src/zone.rs:354 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20262024-09-03T23:57:07.373ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20272024-09-03T23:57:07.373ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 zone = oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6
20282024-09-03T23:57:07.548ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6") failed: Property not found. retry in 37.870024ms file = illumos-utils/src/svc.rs:36 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 zone = oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6
20292024-09-03T23:57:07.595ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6") failed: Property not found. retry in 103.458401ms file = illumos-utils/src/svc.rs:36 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 zone = oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6
20302024-09-03T23:57:07.719ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6") failed: Property not found. retry in 171.254749ms file = illumos-utils/src/svc.rs:36 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 zone = oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6
20312024-09-03T23:57:07.906ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6") failed: Property not found. retry in 543.720915ms file = illumos-utils/src/svc.rs:36 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 zone = oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6
20322024-09-03T23:57:08.464ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6") failed: Property not found. retry in 969.844007ms file = illumos-utils/src/svc.rs:36 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 zone = oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6
20332024-09-03T23:57:09.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40783
20342024-09-03T23:57:09.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54190
20352024-09-03T23:57:09.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54190 req_id = 9e755157-8333-426b-8010-53e7ceaf8897 response_code = 200 uri = /vpc-routes
20362024-09-03T23:57:09.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47378
20372024-09-03T23:57:09.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47378 req_id = 6d54b168-18c9-42e8-bb64-d6671cbbc168 response_code = 200 uri = /vpc-routes
20382024-09-03T23:57:09.446ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6") failed: Property not found. retry in 1.230947032s file = illumos-utils/src/svc.rs:36 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 zone = oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6
20392024-09-03T23:57:09.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47729
20402024-09-03T23:57:09.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47729 req_id = 5f779009-50af-48e6-8264-a4046c84caf0 response_code = 200 uri = /v2p
20412024-09-03T23:57:09.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51912
20422024-09-03T23:57:09.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43027
20432024-09-03T23:57:09.699ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
20442024-09-03T23:57:09.734ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
20452024-09-03T23:57:09.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 120773 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43027 req_id = ea8302df-c9bc-4413-aa65-7b8b861c3e24 response_code = 204 uri = /switch-ports
20462024-09-03T23:57:09.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45209
20472024-09-03T23:57:09.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63445
20482024-09-03T23:57:09.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 387 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43027 req_id = 058f1838-f04f-40cc-80f5-f89497c48759 response_code = 200 uri = /network-bootstore-config
20492024-09-03T23:57:09.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 624 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47378 req_id = 62e27b7f-0e1e-4822-9173-ce254a0e0d16 response_code = 204 uri = /vpc-routes
20502024-09-03T23:57:09.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 449 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54190 req_id = 7fb32ab5-02d1-4d99-9837-c87ee774afeb response_code = 204 uri = /vpc-routes
20512024-09-03T23:57:09.820ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
20522024-09-03T23:57:09.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63445 req_id = 6089a8f1-1127-4c42-bfbc-b2d495050fa1 response_code = 200 uri = /v2p
20532024-09-03T23:57:09.866ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
20542024-09-03T23:57:09.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45209 req_id = 1021edba-ede9-40c8-815c-3aec61e11312 response_code = 204 uri = /switch-ports
20552024-09-03T23:57:09.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45209 req_id = f1499fd8-5fdc-49c6-9521-66fb6e74351f response_code = 200 uri = /network-bootstore-config
20562024-09-03T23:57:09.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55068
20572024-09-03T23:57:10.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34764
20582024-09-03T23:57:10.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34764 req_id = 17e709e8-0f85-423d-aaa9-d0d691e6ded8 response_code = 200 uri = /vpc-routes
20592024-09-03T23:57:10.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34764 req_id = a09a0dc3-a025-4ce8-bb28-7b176e4b4475 response_code = 204 uri = /vpc-routes
20602024-09-03T23:57:10.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34222
20612024-09-03T23:57:10.121ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4038
20622024-09-03T23:57:10.158ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4062
20632024-09-03T23:57:10.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90536 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34222 req_id = e39e809c-26e1-438f-935e-969702a229d5 response_code = 204 uri = /switch-ports
20642024-09-03T23:57:10.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62676
20652024-09-03T23:57:10.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62676 req_id = 229b669d-a556-4e62-85f3-eb2d85e44270 response_code = 200 uri = /v2p
20662024-09-03T23:57:10.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34222 req_id = ffac35b3-fd08-4d06-a048-650be24ef8d9 response_code = 200 uri = /network-bootstore-config
20672024-09-03T23:57:10.688ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6") failed: Property not found. retry in 1.154203783s file = illumos-utils/src/svc.rs:36 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 zone = oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6
20682024-09-03T23:57:11.854ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6") failed: Property not found. retry in 862.019601ms file = illumos-utils/src/svc.rs:36 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 zone = oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6
20692024-09-03T23:57:12.743ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6 file = sled-agent/src/instance.rs:1466 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20702024-09-03T23:57:12.752ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6") failed: Property not found. retry in 29.497897ms file = illumos-utils/src/svc.rs:36 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20712024-09-03T23:57:12.791ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6") failed: Property not found. retry in 130.645288ms file = illumos-utils/src/svc.rs:36 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20722024-09-03T23:57:12.933ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6") failed: Property not found. retry in 255.785024ms file = illumos-utils/src/svc.rs:36 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20732024-09-03T23:57:13.200ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1475 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20742024-09-03T23:57:13.238ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1499 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20752024-09-03T23:57:13.378ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:744 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20762024-09-03T23:57:13.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3790625 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51912 req_id = 11a35b2d-34a7-4305-a488-2dd419237599 response_code = 200 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6/state
20772024-09-03T23:57:13.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3380565 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55068 req_id = 87d3fb03-4f03-4a51-95db-61f531b2890c response_code = 200 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6/state
20782024-09-03T23:57:13.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4039140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40783 req_id = 91768760-63ec-4443-b7ed-66120959344b response_code = 200 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6/state
20792024-09-03T23:57:13.379ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-09-03T23:57:13.379717907Z } file = sled-agent/src/instance.rs:594 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20802024-09-03T23:57:13.379ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-09-03T23:57:13.379717907Z } propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20812024-09-03T23:57:13.379ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-09-03T23:57:13.379717907Z }, migration_in: None, migration_out: None }
20822024-09-03T23:57:13.425ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-09-03T23:57:13.425587584Z } file = sled-agent/src/instance.rs:594 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20832024-09-03T23:57:13.425ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-03T23:57:13.425587584Z } propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20842024-09-03T23:57:13.425ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-03T23:57:13.425587584Z }, migration_in: None, migration_out: None }
20852024-09-03T23:57:22.116ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 11476 local_addr = [fd00:1122:3344:101::1]:34608 method = GET remote_addr = [fd00:1122:3344:101::d]:45913 req_id = b55bfc11-0df9-4c51-bae0-6646699e4445 response_code = 200 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a uri = /b281022b-35b2-452e-ad2b-78e12f6ca16a
20862024-09-03T23:57:22.542ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43692
20872024-09-03T23:57:22.542ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43692 req_id = 6f99868d-76ff-4470-845b-5d7d4254f7af response_code = 200 uri = /baseboard
20882024-09-03T23:57:23.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61464
20892024-09-03T23:57:23.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 492 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61464 req_id = 29deec06-81f0-443a-be58-c450eb9c5aaf response_code = 200 uri = /vmms/48c3ff33-2c5c-416c-b826-70461a3d6db6/state
20902024-09-03T23:57:23.559ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-09-03T23:57:23.559576758Z } file = sled-agent/src/instance.rs:594 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20912024-09-03T23:57:23.559ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-09-03T23:57:23.559576758Z } propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20922024-09-03T23:57:23.559ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-09-03T23:57:23.559576758Z }, migration_in: None, migration_out: None }
20932024-09-03T23:57:23.578ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-09-03T23:57:23.578675449Z } file = sled-agent/src/instance.rs:594 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20942024-09-03T23:57:23.578ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:616 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-09-03T23:57:23.578675449Z } propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20952024-09-03T23:57:23.578ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:630 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
20962024-09-03T23:57:23.578ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
20972024-09-03T23:57:23.578ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:557 id = 14444184340828543144 n_samples = 6 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
20982024-09-03T23:57:23.578ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:557 id = 11932376679130077 n_samples = 6 sled_id = b281022b-35b2-452e-ad2b-78e12f6ca16a
20992024-09-03T23:57:23.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
21002024-09-03T23:57:23.580ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/287d8187-80e6-478c-877b-4a09970caed2/debug/bundle/zone", "/pool/int/e599ee5f-97c7-4995-8dd0-33bab0f35ae9/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/e0561e5a-5452-4106-b6b0-062a7d784293/crypt/debug", "/pool/ext/2cbe1d4d-d15f-4df5-bb04-76918350f53e/crypt/debug", "/pool/ext/93f19386-05be-4b48-8c7f-97b089021599/crypt/debug", "/pool/ext/004daad2-caa8-4a89-a0fc-7c1f8227b87e/crypt/debug", "/pool/ext/f8732c0b-71fb-4387-a914-529c0b914060/crypt/debug", "/pool/ext/30819714-9407-4088-b589-159a446db142/crypt/debug", "/pool/ext/96307640-3db4-4a6e-b03a-71a80f6a607d/crypt/debug", "/pool/ext/4b93cc0a-b0c7-45b7-8ce5-27d999bbaffc/crypt/debug", "/pool/ext/7d26dc1e-4276-483d-aac3-2ccee06bc9a7/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6
21012024-09-03T23:57:24.217ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6", bundle_id: ab0648f2-f573-4034-b4f0-d22bb8c0b11b }, time_created: 2024-09-03T23:57:23.580927078Z, version: 0, cause: TerminatedInstance }
21022024-09-03T23:57:24.217ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_48c3ff33-2c5c-416c-b826-70461a3d6db6 file = sled-agent/src/instance.rs:843 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
21032024-09-03T23:57:25.960ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:270 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
21042024-09-03T23:57:25.977ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:904 id = RouterId { vni: Vni(14558931), kind: System }
21052024-09-03T23:57:25.977ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:904 id = RouterId { vni: Vni(14558931), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
21062024-09-03T23:57:25.978ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-03T23:57:25.978338776Z }, migration_in: None, migration_out: None }
21072024-09-03T23:57:26.016ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:514 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-03T23:57:25.978338776Z }, migration_in: None, migration_out: None }
21082024-09-03T23:57:26.021ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:780 instance_id = 57689d15-57f5-498e-ba97-26ce1fb9565d propolis_id = 48c3ff33-2c5c-416c-b826-70461a3d6db6
21092024-09-03T23:57:26.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55310
21102024-09-03T23:57:26.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55310 req_id = 16c74849-546a-462a-8364-7754dc4d04c6 response_code = 200 uri = /vpc-routes
21112024-09-03T23:57:26.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55310 req_id = 800da40c-e821-45ff-811f-c0711a026400 response_code = 204 uri = /vpc-routes
21122024-09-03T23:57:26.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45426
21132024-09-03T23:57:26.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45426 req_id = bd9cfc18-0aa6-4c24-8f82-007f86e76e17 response_code = 200 uri = /v2p
21142024-09-03T23:57:27.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40604
21152024-09-03T23:57:27.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40604 req_id = 1a87c631-bb69-4457-b2b0-e73e42c78a2f response_code = 200 uri = /v2p
21162024-09-03T23:57:28.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60183
21172024-09-03T23:57:28.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60183 req_id = e5710325-c0c4-455c-9bed-72735d0d2216 response_code = 200 uri = /vpc-routes
21182024-09-03T23:57:28.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 765 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60183 req_id = f1c52b75-94c4-4186-a7a6-1b4b9fdbe837 response_code = 204 uri = /vpc-routes