Max level shown:
1 [ Nov 7 02:39:15 Enabled. ]
2 [ Nov 7 02:39:15 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 7 02:39:15 Method "start" exited with status 0. ]
4 [ Nov 7 02:39:15 Rereading configuration. ]
5 [ Nov 7 02:39:15 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-07T02:39:15.563ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-07T02:39:15.564ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-07T02:39:15.615ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-07T02:39:15.615ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-07T02:39:15.729ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-07T02:39:15.737ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-07T02:39:15.745ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-07T02:39:16.349ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-07T02:39:16.484ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-07T02:39:16.484ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-07T02:39:16.484ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-07T02:39:16.484ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-07T02:39:16.484ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-07T02:39:16.484ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-07T02:39:16.488ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-07T02:39:16.488ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-07T02:39:16.488ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-07T02:39:16.488ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-07T02:39:16.488ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-07T02:39:16.488ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-07T02:39:16.488ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
282024-11-07T02:39:16.488ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-07T02:39:16.488ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-07T02:39:16.500ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-07T02:39:16.500ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool)
322024-11-07T02:39:16.625ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal }
332024-11-07T02:39:17.196ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
342024-11-07T02:39:17.196ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-07T02:39:17.196ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-07T02:39:17.196ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-07T02:39:17.196ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
382024-11-07T02:39:17.196ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-07T02:39:17.196ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-07T02:39:17.205ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-07T02:39:17.205ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool)
422024-11-07T02:39:17.314ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal }
432024-11-07T02:39:17.879ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-07T02:39:17.879ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-07T02:39:17.879ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-07T02:39:17.879ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
472024-11-07T02:39:17.879ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482024-11-07T02:39:17.879ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-07T02:39:17.879ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
502024-11-07T02:39:17.879ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
512024-11-07T02:39:17.879ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-07T02:39:17.879ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-11-07T02:39:17.879ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
542024-11-07T02:39:17.879ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-07T02:39:17.879ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-07T02:39:17.879ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-07T02:39:17.879ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582024-11-07T02:39:17.879ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592024-11-07T02:39:17.879ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
602024-11-07T02:39:17.879ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-11-07T02:39:17.879ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-07T02:39:17.879ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
632024-11-07T02:39:17.879ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642024-11-07T02:39:17.879ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-11-07T02:39:17.879ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-07T02:39:17.879ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-07T02:39:17.879ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-07T02:39:17.879ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
692024-11-07T02:39:17.879ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702024-11-07T02:39:17.879ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712024-11-07T02:39:17.879ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722024-11-07T02:39:17.879ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-11-07T02:39:17.879ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-07T02:39:17.879ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-07T02:39:17.880ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-07T02:39:17.880ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-07T02:39:17.880ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
782024-11-07T02:39:17.880ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-07T02:39:17.880ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-07T02:39:17.880ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-07T02:39:17.880ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-11-07T02:39:17.880ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-11-07T02:39:17.880ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
842024-11-07T02:39:17.880ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-07T02:39:17.880ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-07T02:39:17.880ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
872024-11-07T02:39:17.880ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
882024-11-07T02:39:17.880ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892024-11-07T02:39:17.880ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-11-07T02:39:17.880ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-07T02:39:17.880ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-07T02:39:17.880ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
932024-11-07T02:39:17.880ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-07T02:39:17.880ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-07T02:39:17.880ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-07T02:39:17.880ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-07T02:39:17.880ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-07T02:39:17.880ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-07T02:39:17.880ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-07T02:39:17.880ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-07T02:39:17.880ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-07T02:39:17.880ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1032024-11-07T02:39:17.880ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-07T02:39:17.880ZINFOSledAgent (bootstore): No ledger in /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-11-07T02:39:17.880ZINFOSledAgent (bootstore): No ledger in /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-11-07T02:39:17.880ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-07T02:39:17.880ZINFOSledAgent (bootstore): No ledger in /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-11-07T02:39:17.880ZINFOSledAgent (bootstore): No ledger in /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-11-07T02:39:17.880ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-07T02:39:17.880ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-07T02:39:17.880ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-07T02:39:17.891ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:733
1132024-11-07T02:39:17.891ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1372, tv_nsec: 764456573 } time_to_next_cleanup = 599.999930358s
1142024-11-07T02:39:17.891ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3910
1152024-11-07T02:39:17.891ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1162024-11-07T02:39:17.891ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-07T02:39:17.894ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-07T02:39:17.895ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-07T02:39:17.896ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-07T02:39:17.897ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1083
1212024-11-07T02:39:17.897ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-07T02:39:17.897ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1232024-11-07T02:39:17.897ZINFOSledAgent (RSS): No ledger in /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-07T02:39:17.897ZINFOSledAgent (RSS): No ledger in /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-07T02:39:17.897ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1146
1262024-11-07T02:39:17.897ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1272024-11-07T02:39:17.897ZINFOSledAgent (RSS): No ledger in /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-07T02:39:17.897ZINFOSledAgent (RSS): No ledger in /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-07T02:39:17.897ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1188
1302024-11-07T02:39:17.897ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-07T02:39:17.897ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-07T02:39:17.897ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1332024-11-07T02:39:17.897ZINFOSledAgent (RSS): Writing ledger to /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-07T02:39:17.898ZINFOSledAgent (RSS): Writing ledger to /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-07T02:39:17.898ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ed4702f9-ad41-4221-9a83-4f7d256be0d9 (sled), rack_id: b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-07T02:39:17.898ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1222
1372024-11-07T02:39:17.898ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-11-07T02:39:17.898ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-11-07T02:39:17.898ZINFOSledAgent (bootstore): Writing ledger to /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-11-07T02:39:17.898ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-11-07T02:39:17.898ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ed4702f9-ad41-4221-9a83-4f7d256be0d9 (sled), rack_id: b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-11-07T02:39:17.899ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4207
1432024-11-07T02:39:17.899ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4589
1442024-11-07T02:39:17.904ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-07T02:39:17.909ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-07T02:39:17.910ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-07T02:39:17.914ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-07T02:39:17.914ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-07T02:39:17.914ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:36097
1502024-11-07T02:39:17.915ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ed4702f9-ad41-4221-9a83-4f7d256be0d9 (sled), rack_id: b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-07T02:39:17.915ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-07T02:39:17.915ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-07T02:39:17.915ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-07T02:39:17.915ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:451
1552024-11-07T02:39:17.915ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:644
1562024-11-07T02:39:17.915ZINFOSledAgent (StorageManager): No ledger in /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-11-07T02:39:17.915ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1582024-11-07T02:39:17.915ZINFOSledAgent (StorageManager): No ledger in /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-07T02:39:17.915ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:633
1602024-11-07T02:39:17.915ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:661
1612024-11-07T02:39:17.915ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:440
1622024-11-07T02:39:17.915ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-07T02:39:17.915ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:532 result = DisksManagementResult { status: [] }
1642024-11-07T02:39:17.929ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1652024-11-07T02:39:17.951ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-07T02:39:17.968ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-07T02:39:17.977ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
1682024-11-07T02:39:17.977ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1692024-11-07T02:39:17.977ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
1702024-11-07T02:39:17.977ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-07T02:39:17.980ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 132.595284ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fbc3464e-a3ba-4626-bcb4-4e2a9bd178af", "content-length": "124", "date": "Thu, 07 Nov 2024 02:39:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fbc3464e-a3ba-4626-bcb4-4e2a9bd178af" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-07T02:39:17.990ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_f9d1c415-0734-4c1d-bad4-f5afd5058370/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-07T02:39:18.020ZINFOSledAgent: successfully created encrypted zvol: name="oxi_f9d1c415-0734-4c1d-bad4-f5afd5058370/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-07T02:39:18.020ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_f9d1c415-0734-4c1d-bad4-f5afd5058370/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-07T02:39:18.025ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
1762024-11-07T02:39:18.025ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-07T02:39:18.025ZINFOSledAgent (BackingFs): Ensuring dataset oxi_f9d1c415-0734-4c1d-bad4-f5afd5058370/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-07T02:39:18.114ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-07T02:39:18.115ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 132.766595ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "384bc0bc-9105-4703-9b81-2310501a5a63", "content-length": "124", "date": "Thu, 07 Nov 2024 02:39:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "384bc0bc-9105-4703-9b81-2310501a5a63" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-07T02:39:18.118ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-07T02:39:18.248ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-07T02:39:18.249ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 113.261188ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c43289b1-b9e6-49e7-b8f4-75945931fb73", "content-length": "124", "date": "Thu, 07 Nov 2024 02:39:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c43289b1-b9e6-49e7-b8f4-75945931fb73" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-07T02:39:18.337ZINFOSledAgent (BackingFs): Mounting oxi_f9d1c415-0734-4c1d-bad4-f5afd5058370/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-11-07T02:39:18.350ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-11-07T02:39:18.350ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-11-07T02:39:18.350ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-11-07T02:39:18.350ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-11-07T02:39:18.364ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-07T02:39:18.365ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 243.745556ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "37b44d40-58ab-432b-a42e-c43ac4b3ec4c", "content-length": "124", "date": "Thu, 07 Nov 2024 02:39:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "37b44d40-58ab-432b-a42e-c43ac4b3ec4c" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-07T02:39:18.609ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-07T02:39:18.610ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 159.936012ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f3d86ac2-0282-48e9-a7f5-690381c27dbb", "content-length": "124", "date": "Thu, 07 Nov 2024 02:39:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f3d86ac2-0282-48e9-a7f5-690381c27dbb" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-07T02:39:18.771ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-07T02:39:18.772ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 159.334046ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "63ef0466-fa75-487d-800b-ac6b2cc79bd5", "content-length": "124", "date": "Thu, 07 Nov 2024 02:39:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "63ef0466-fa75-487d-800b-ac6b2cc79bd5" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-07T02:39:18.933ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-07T02:39:18.933ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 165.532231ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "151e5621-5906-4ed4-a88d-01712104961c", "content-length": "124", "date": "Thu, 07 Nov 2024 02:39:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "151e5621-5906-4ed4-a88d-01712104961c" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-07T02:39:19.092ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
1972024-11-07T02:39:19.097ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:48082 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
1982024-11-07T02:39:19.097ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
1992024-11-07T02:39:19.097ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:48082 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2002024-11-07T02:39:19.099ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 204.796336ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2012024-11-07T02:39:19.099ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2022024-11-07T02:39:19.100ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2032024-11-07T02:39:19.100ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:917 underlay_address = fd00:1122:3344:101::1
2042024-11-07T02:39:19.100ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-11-07T02:39:19.100ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062024-11-07T02:39:19.305ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 488.295007ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2072024-11-07T02:39:19.795ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.177753413s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2082024-11-07T02:39:20.975ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.772750767s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2092024-11-07T02:39:21.480ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2664
2102024-11-07T02:39:21.480ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2882
2112024-11-07T02:39:21.480ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2534
2122024-11-07T02:39:21.480ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2581
2132024-11-07T02:39:21.480ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2963
2142024-11-07T02:39:21.480ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3005
2152024-11-07T02:39:21.482ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2807
2162024-11-07T02:39:21.483ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2575
2172024-11-07T02:39:21.483ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='7d53a818-517a-4e34-b205-c6b433ed69c7'/> <propval type="astring" name="rack_id" value='b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe67:f47'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='ed4702f9-ad41-4221-9a83-4f7d256be0d9'/> <propval type="astring" name="rack_id" value='b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='ed4702f9-ad41-4221-9a83-4f7d256be0d9'/> <propval type="astring" name="rack_uuid" value='b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='ed4702f9-ad41-4221-9a83-4f7d256be0d9'/> <propval type="astring" name="rack_uuid" value='b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-07T02:39:21.484ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-07T02:39:21.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 62.714243ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-07T02:39:22.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 51.207324ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-07T02:39:22.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 170.389008ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-07T02:39:22.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 336.395155ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-07T02:39:23.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 975.30118ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-07T02:39:23.750ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.127190617s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2252024-11-07T02:39:24.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.441530746s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-07T02:39:25.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.054530184s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-07T02:39:25.880ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.138019383s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2282024-11-07T02:39:26.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.077517639s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-07T02:39:28.406ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/nexus.rs:527 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2302024-11-07T02:39:28.444ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2312024-11-07T02:39:28.444ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2322024-11-07T02:39:28.445ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12345
2332024-11-07T02:39:28.445ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2342024-11-07T02:39:28.445ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2352024-11-07T02:39:28.445ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-07T02:39:28.445ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-07T02:39:28.445ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2382024-11-07T02:39:28.445ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2392024-11-07T02:39:28.445ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3910
2402024-11-07T02:39:28.445ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:36097
2412024-11-07T02:39:28.646ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2422024-11-07T02:39:28.646ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2432024-11-07T02:39:28.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2442024-11-07T02:39:28.646ZINFOSledAgent (RSS): No ledger in /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-07T02:39:28.646ZINFOSledAgent (RSS): No ledger in /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-07T02:39:28.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2472024-11-07T02:39:28.647ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2482024-11-07T02:39:28.647ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2492024-11-07T02:39:28.647ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2502024-11-07T02:39:28.651ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4231 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2512024-11-07T02:39:28.651ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4247
2522024-11-07T02:39:28.651ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2532024-11-07T02:39:28.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42102
2542024-11-07T02:39:28.897ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2552024-11-07T02:39:28.897ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2562024-11-07T02:39:28.897ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-11-07T02:39:28.897ZINFOSledAgent (ServiceManager): No ledger in /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-07T02:39:28.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 435 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42102 req_id = 21bfe664-90ce-4170-a7be-43b9106b1333 response_code = 200 uri = /inventory
2592024-11-07T02:39:28.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61093
2602024-11-07T02:39:28.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61093 req_id = 7dd2da8e-8c40-4972-ab14-861752b08307 response_code = 200 uri = /sled-role
2612024-11-07T02:39:28.928ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2622024-11-07T02:39:28.928ZINFOSledAgent (RSS): Writing ledger to /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-11-07T02:39:28.928ZINFOSledAgent (RSS): Writing ledger to /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-07T02:39:28.928ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:886
2652024-11-07T02:39:28.957ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 5f471e59-7ea6-4fcf-94ca-01a40d15ca9b, pool_id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 199b1797-5422-45fc-bb44-37b37c120c9b, pool_id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a61fa32c-d294-4433-b788-8bb171f6ad22, pool_id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 08309990-06e6-4b0c-b694-7e777de65bb3, pool_id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 478348c0-fc68-49a5-9a3a-f0b082693907, pool_id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a5c4b91d-52ec-4ed6-b5c8-4ecaf49c81ae, pool_id: dddcfc0e-109d-4074-b924-e7a90aa78ab4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: c3ca9f19-b65e-451d-8dcb-71e56dae467f, pool_id: 93fe9b26-7c2f-4e28-82f2-0a5320409e66 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 9e05e69b-240b-4859-b6bb-afeabe93709a, pool_id: 01d7d0b3-ada7-4e85-a6b4-686ef3c7940e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 5b2f9690-e718-4cd4-9084-dcc50a679b4c, pool_id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:376 sled_address = [fd00:1122:3344:101::1]:12345
2662024-11-07T02:39:28.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47044
2672024-11-07T02:39:28.958ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:886 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2682024-11-07T02:39:28.958ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 5f471e59-7ea6-4fcf-94ca-01a40d15ca9b, pool_id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 199b1797-5422-45fc-bb44-37b37c120c9b, pool_id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a61fa32c-d294-4433-b788-8bb171f6ad22, pool_id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 08309990-06e6-4b0c-b694-7e777de65bb3, pool_id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 478348c0-fc68-49a5-9a3a-f0b082693907, pool_id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a5c4b91d-52ec-4ed6-b5c8-4ecaf49c81ae, pool_id: dddcfc0e-109d-4074-b924-e7a90aa78ab4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: c3ca9f19-b65e-451d-8dcb-71e56dae467f, pool_id: 93fe9b26-7c2f-4e28-82f2-0a5320409e66 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 9e05e69b-240b-4859-b6bb-afeabe93709a, pool_id: 01d7d0b3-ada7-4e85-a6b4-686ef3c7940e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 5b2f9690-e718-4cd4-9084-dcc50a679b4c, pool_id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:451
2692024-11-07T02:39:28.958ZINFOSledAgent (StorageManager): No ledger in /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-11-07T02:39:28.958ZINFOSledAgent (StorageManager): No ledger in /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-07T02:39:28.958ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:866 request = omicron_physical_disks_ensure
2722024-11-07T02:39:28.958ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2732024-11-07T02:39:28.958ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2742024-11-07T02:39:28.958ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2752024-11-07T02:39:28.958ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2762024-11-07T02:39:29.110ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2772024-11-07T02:39:29.110ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2782024-11-07T02:39:29.117ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2792024-11-07T02:39:29.117ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool)
2802024-11-07T02:39:29.317ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2812024-11-07T02:39:29.425ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }
2822024-11-07T02:39:29.433ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:225
2832024-11-07T02:39:29.433ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:227
2842024-11-07T02:39:29.433ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:231
2852024-11-07T02:39:29.433ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:233
2862024-11-07T02:39:29.433ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-11-07T02:39:29.433ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-07T02:39:29.433ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
2892024-11-07T02:39:29.447ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
2902024-11-07T02:39:29.476ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-11-07T02:39:29.484ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_54f9243c-18e6-42c9-935c-0dc4151c5bea/crypt/zone file = sled-storage/src/dataset.rs:288
2922024-11-07T02:39:29.689ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_54f9243c-18e6-42c9-935c-0dc4151c5bea file = sled-storage/src/dataset.rs:374
2932024-11-07T02:39:29.696ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2942024-11-07T02:39:29.696ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2952024-11-07T02:39:29.696ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2962024-11-07T02:39:29.696ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2972024-11-07T02:39:29.696ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2982024-11-07T02:39:29.705ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2992024-11-07T02:39:29.705ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1e683710-2494-4ab1-a637-7b528e143c16 (zpool)
3002024-11-07T02:39:29.813ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }
3012024-11-07T02:39:29.821ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:225
3022024-11-07T02:39:29.821ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:227
3032024-11-07T02:39:29.821ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:231
3042024-11-07T02:39:29.821ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:233
3052024-11-07T02:39:29.821ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3062024-11-07T02:39:29.821ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-07T02:39:29.821ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3082024-11-07T02:39:29.864ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3092024-11-07T02:39:29.871ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1e683710-2494-4ab1-a637-7b528e143c16/crypt/zone file = sled-storage/src/dataset.rs:288
3102024-11-07T02:39:30.075ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1e683710-2494-4ab1-a637-7b528e143c16 file = sled-storage/src/dataset.rs:374
3112024-11-07T02:39:30.083ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3122024-11-07T02:39:30.083ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3132024-11-07T02:39:30.083ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3142024-11-07T02:39:30.083ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3152024-11-07T02:39:30.083ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3162024-11-07T02:39:30.093ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3172024-11-07T02:39:30.093ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e6e52c0a-a969-4298-91e8-02888028eb67 (zpool)
3182024-11-07T02:39:30.206ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }
3192024-11-07T02:39:30.214ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:225
3202024-11-07T02:39:30.214ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:227
3212024-11-07T02:39:30.214ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:231
3222024-11-07T02:39:30.215ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:233
3232024-11-07T02:39:30.215ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3242024-11-07T02:39:30.215ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-07T02:39:30.215ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3262024-11-07T02:39:30.259ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3272024-11-07T02:39:30.266ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e6e52c0a-a969-4298-91e8-02888028eb67/crypt/zone file = sled-storage/src/dataset.rs:288
3282024-11-07T02:39:30.449ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
3292024-11-07T02:39:30.478ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e6e52c0a-a969-4298-91e8-02888028eb67 file = sled-storage/src/dataset.rs:374
3302024-11-07T02:39:30.487ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3312024-11-07T02:39:30.487ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3322024-11-07T02:39:30.487ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3332024-11-07T02:39:30.487ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3342024-11-07T02:39:30.487ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3352024-11-07T02:39:30.496ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3362024-11-07T02:39:30.496ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool)
3372024-11-07T02:39:30.619ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }
3382024-11-07T02:39:30.626ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:225
3392024-11-07T02:39:30.626ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:227
3402024-11-07T02:39:30.626ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:231
3412024-11-07T02:39:30.626ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:233
3422024-11-07T02:39:30.626ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-07T02:39:30.627ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-07T02:39:30.627ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3452024-11-07T02:39:30.676ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3462024-11-07T02:39:30.684ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9ad521f2-498d-459f-9590-bf571f0f7fe6/crypt/zone file = sled-storage/src/dataset.rs:288
3472024-11-07T02:39:30.895ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9ad521f2-498d-459f-9590-bf571f0f7fe6 file = sled-storage/src/dataset.rs:374
3482024-11-07T02:39:30.902ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3492024-11-07T02:39:30.902ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3502024-11-07T02:39:30.902ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3512024-11-07T02:39:30.902ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3522024-11-07T02:39:30.902ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3532024-11-07T02:39:30.912ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3542024-11-07T02:39:30.912ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7779de2f-377d-433e-9f3f-656a23324b51 (zpool)
3552024-11-07T02:39:31.019ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External }
3562024-11-07T02:39:31.026ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:225
3572024-11-07T02:39:31.026ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:227
3582024-11-07T02:39:31.026ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:231
3592024-11-07T02:39:31.026ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:233
3602024-11-07T02:39:31.026ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3612024-11-07T02:39:31.027ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-07T02:39:31.027ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3632024-11-07T02:39:31.072ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3642024-11-07T02:39:31.081ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7779de2f-377d-433e-9f3f-656a23324b51/crypt/zone file = sled-storage/src/dataset.rs:288
3652024-11-07T02:39:31.278ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7779de2f-377d-433e-9f3f-656a23324b51 file = sled-storage/src/dataset.rs:374
3662024-11-07T02:39:31.286ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3672024-11-07T02:39:31.286ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3682024-11-07T02:39:31.286ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3692024-11-07T02:39:31.286ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3702024-11-07T02:39:31.286ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3712024-11-07T02:39:31.295ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3722024-11-07T02:39:31.295ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = dddcfc0e-109d-4074-b924-e7a90aa78ab4 (zpool)
3732024-11-07T02:39:31.412ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: dddcfc0e-109d-4074-b924-e7a90aa78ab4 (zpool), kind: External }
3742024-11-07T02:39:31.419ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:225
3752024-11-07T02:39:31.419ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:227
3762024-11-07T02:39:31.419ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:231
3772024-11-07T02:39:31.419ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:233
3782024-11-07T02:39:31.419ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3792024-11-07T02:39:31.420ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-07T02:39:31.420ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3812024-11-07T02:39:31.451ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
3822024-11-07T02:39:31.463ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3832024-11-07T02:39:31.471ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_dddcfc0e-109d-4074-b924-e7a90aa78ab4/crypt/zone file = sled-storage/src/dataset.rs:288
3842024-11-07T02:39:31.689ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_dddcfc0e-109d-4074-b924-e7a90aa78ab4 file = sled-storage/src/dataset.rs:374
3852024-11-07T02:39:31.697ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3862024-11-07T02:39:31.697ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3872024-11-07T02:39:31.697ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3882024-11-07T02:39:31.697ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3892024-11-07T02:39:31.697ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3902024-11-07T02:39:31.707ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3912024-11-07T02:39:31.707ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 93fe9b26-7c2f-4e28-82f2-0a5320409e66 (zpool)
3922024-11-07T02:39:31.822ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 93fe9b26-7c2f-4e28-82f2-0a5320409e66 (zpool), kind: External }
3932024-11-07T02:39:31.831ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:225
3942024-11-07T02:39:31.831ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:227
3952024-11-07T02:39:31.831ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:231
3962024-11-07T02:39:31.831ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:233
3972024-11-07T02:39:31.831ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-11-07T02:39:31.831ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-07T02:39:31.831ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4002024-11-07T02:39:31.874ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4012024-11-07T02:39:31.882ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_93fe9b26-7c2f-4e28-82f2-0a5320409e66/crypt/zone file = sled-storage/src/dataset.rs:288
4022024-11-07T02:39:32.085ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_93fe9b26-7c2f-4e28-82f2-0a5320409e66 file = sled-storage/src/dataset.rs:374
4032024-11-07T02:39:32.092ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4042024-11-07T02:39:32.092ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4052024-11-07T02:39:32.092ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4062024-11-07T02:39:32.092ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4072024-11-07T02:39:32.092ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4082024-11-07T02:39:32.102ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4092024-11-07T02:39:32.102ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 01d7d0b3-ada7-4e85-a6b4-686ef3c7940e (zpool)
4102024-11-07T02:39:32.216ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 01d7d0b3-ada7-4e85-a6b4-686ef3c7940e (zpool), kind: External }
4112024-11-07T02:39:32.224ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:225
4122024-11-07T02:39:32.224ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:227
4132024-11-07T02:39:32.224ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:231
4142024-11-07T02:39:32.224ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:233
4152024-11-07T02:39:32.224ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4162024-11-07T02:39:32.224ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-07T02:39:32.224ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4182024-11-07T02:39:32.267ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4192024-11-07T02:39:32.274ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_01d7d0b3-ada7-4e85-a6b4-686ef3c7940e/crypt/zone file = sled-storage/src/dataset.rs:288
4202024-11-07T02:39:32.454ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
4212024-11-07T02:39:32.477ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_01d7d0b3-ada7-4e85-a6b4-686ef3c7940e file = sled-storage/src/dataset.rs:374
4222024-11-07T02:39:32.485ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-11-07T02:39:32.485ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-11-07T02:39:32.485ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-11-07T02:39:32.485ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-11-07T02:39:32.485ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-11-07T02:39:32.494ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-11-07T02:39:32.494ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool)
4292024-11-07T02:39:32.608ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool), kind: External }
4302024-11-07T02:39:32.614ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:225
4312024-11-07T02:39:32.614ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:227
4322024-11-07T02:39:32.614ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:231
4332024-11-07T02:39:32.614ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:233
4342024-11-07T02:39:32.614ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-07T02:39:32.614ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-07T02:39:32.614ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4372024-11-07T02:39:32.655ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4382024-11-07T02:39:32.664ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_655eee30-398b-4d0f-848d-1f66d242e6b9/crypt/zone file = sled-storage/src/dataset.rs:288
4392024-11-07T02:39:32.867ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_655eee30-398b-4d0f-848d-1f66d242e6b9 file = sled-storage/src/dataset.rs:374
4402024-11-07T02:39:32.875ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4412024-11-07T02:39:32.875ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4422024-11-07T02:39:32.875ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4432024-11-07T02:39:32.875ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9d1c415-0734-4c1d-bad4-f5afd5058370 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d322320-6b0c-4ce3-949b-64e290d203c6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dddcfc0e-109d-4074-b924-e7a90aa78ab4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 93fe9b26-7c2f-4e28-82f2-0a5320409e66 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01d7d0b3-ada7-4e85-a6b4-686ef3c7940e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4442024-11-07T02:39:32.875ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4452024-11-07T02:39:32.875ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4462024-11-07T02:39:32.875ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4472024-11-07T02:39:32.875ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:890 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
4482024-11-07T02:39:32.875ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4492024-11-07T02:39:32.875ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:916 generation = Generation(1) sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
4502024-11-07T02:39:32.875ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:921 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
4512024-11-07T02:39:32.876ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:926 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
4522024-11-07T02:39:32.876ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
4532024-11-07T02:39:32.876ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:932 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
4542024-11-07T02:39:32.876ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4552024-11-07T02:39:32.876ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:937 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
4562024-11-07T02:39:32.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3918075 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47044 req_id = eaa81400-fcba-4fb4-b4f1-60a8077c9472 response_code = 200 uri = /omicron-physical-disks
4572024-11-07T02:39:32.907ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d (service), filesystem_pool: Some(ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 69f913d1-faa1-4ef2-b58b-1ff75217594c (service), filesystem_pool: Some(ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 66e6e8a1-7b35-4429-9278-b472618144c5 (service), filesystem_pool: Some(ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
4582024-11-07T02:39:32.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47207
4592024-11-07T02:39:32.907ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4602024-11-07T02:39:32.907ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: InternalDns }, responder: ... }
4612024-11-07T02:39:32.968ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69f913d1-faa1-4ef2-b58b-1ff75217594c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4622024-11-07T02:39:32.968ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 69f913d1-faa1-4ef2-b58b-1ff75217594c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4632024-11-07T02:39:33.027ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 66e6e8a1-7b35-4429-9278-b472618144c5, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4642024-11-07T02:39:33.027ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 66e6e8a1-7b35-4429-9278-b472618144c5, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4652024-11-07T02:39:33.087ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4662024-11-07T02:39:33.087ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:188
4672024-11-07T02:39:33.087ZINFOSledAgent (ServiceManager): No ledger in /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:188
4682024-11-07T02:39:33.087ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4692024-11-07T02:39:33.132ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4702024-11-07T02:39:33.132ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4712024-11-07T02:39:33.132ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4722024-11-07T02:39:33.182ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d file = illumos-utils/src/zone.rs:325
4732024-11-07T02:39:33.186ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5 file = illumos-utils/src/zone.rs:325
4742024-11-07T02:39:33.190ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c file = illumos-utils/src/zone.rs:325
4752024-11-07T02:39:33.201ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d file = illumos-utils/src/zone.rs:363
4762024-11-07T02:39:33.206ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5 file = illumos-utils/src/zone.rs:363
4772024-11-07T02:39:33.210ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c file = illumos-utils/src/zone.rs:363
4782024-11-07T02:39:33.456ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
4792024-11-07T02:39:34.790ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4802024-11-07T02:39:34.790ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4812024-11-07T02:39:35.267ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4822024-11-07T02:39:35.743ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4832024-11-07T02:39:35.743ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4842024-11-07T02:39:35.743ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
4852024-11-07T02:39:35.747ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4862024-11-07T02:39:35.747ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
4872024-11-07T02:39:35.751ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
4882024-11-07T02:39:35.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c") failed: Property not found. retry in 74.885914ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
4892024-11-07T02:39:35.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d") failed: Property not found. retry in 33.854997ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
4902024-11-07T02:39:35.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5") failed: Property not found. retry in 47.54872ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
4912024-11-07T02:39:35.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d") failed: Property not found. retry in 97.851554ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
4922024-11-07T02:39:36.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5") failed: Property not found. retry in 79.712279ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
4932024-11-07T02:39:36.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d") failed: Property not found. retry in 230.172823ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
4942024-11-07T02:39:36.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c") failed: Property not found. retry in 96.805204ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
4952024-11-07T02:39:36.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5") failed: Property not found. retry in 168.483341ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
4962024-11-07T02:39:36.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d") failed: Property not found. retry in 572.80298ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
4972024-11-07T02:39:36.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c") failed: Property not found. retry in 219.448906ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
4982024-11-07T02:39:36.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5") failed: Property not found. retry in 483.968994ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
4992024-11-07T02:39:36.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c") failed: Property not found. retry in 451.118125ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
5002024-11-07T02:39:36.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d") failed: Property not found. retry in 1.144227222s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
5012024-11-07T02:39:36.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5") failed: Property not found. retry in 432.816086ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
5022024-11-07T02:39:37.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c") failed: Property not found. retry in 635.692633ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
5032024-11-07T02:39:37.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5") failed: Property not found. retry in 1.448509953s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
5042024-11-07T02:39:37.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c") failed: Property not found. retry in 1.080192187s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
5052024-11-07T02:39:37.894ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4255
5062024-11-07T02:39:37.894ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4265 gateway = fd00:1122:3344:101::1
5072024-11-07T02:39:37.900ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4344
5082024-11-07T02:39:38.008ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4392
5092024-11-07T02:39:38.008ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4419
5102024-11-07T02:39:38.050ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4432
5112024-11-07T02:39:38.050ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4296
5122024-11-07T02:39:38.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d") failed: Property not found. retry in 1.395821357s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
5132024-11-07T02:39:38.110ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4338
5142024-11-07T02:39:38.110ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4399 rack_subnet = fd00:1122:3344::
5152024-11-07T02:39:38.132ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4410
5162024-11-07T02:39:38.132ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4452
5172024-11-07T02:39:38.205ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4484
5182024-11-07T02:39:38.205ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4490
5192024-11-07T02:39:38.292ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4531
5202024-11-07T02:39:38.293ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5212024-11-07T02:39:38.326ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 68.76688ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5222024-11-07T02:39:38.395ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 75.345416ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5232024-11-07T02:39:38.408ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9642745831105742236 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
5242024-11-07T02:39:38.408ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12731437480929874151 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
5252024-11-07T02:39:38.471ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 131.817577ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5262024-11-07T02:39:38.604ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 239.715559ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5272024-11-07T02:39:38.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:41410
5282024-11-07T02:39:38.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:41410 req_id = bf8e9713-1eb9-4794-9a7c-1050c31b645a response_code = 200 uri = /sled-identifiers
5292024-11-07T02:39:38.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c") failed: Property not found. retry in 1.353944497s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
5302024-11-07T02:39:38.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5") failed: Property not found. retry in 957.445094ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
5312024-11-07T02:39:38.852ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
5322024-11-07T02:39:38.885ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
5332024-11-07T02:39:38.885ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
5342024-11-07T02:39:38.885ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 0
5352024-11-07T02:39:38.885ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
5362024-11-07T02:39:38.923ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
5372024-11-07T02:39:38.979ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
5382024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5392024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5402024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5412024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5422024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5432024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5442024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5452024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5462024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5472024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5482024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5492024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5502024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5512024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5522024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5532024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5542024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5552024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5562024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5572024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5582024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5592024-11-07T02:39:38.979ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5602024-11-07T02:39:39.113ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
5612024-11-07T02:39:39.113ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
5622024-11-07T02:39:39.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d") failed: Property not found. retry in 1.371040713s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
5632024-11-07T02:39:39.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5") failed: Property not found. retry in 875.279872ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
5642024-11-07T02:39:40.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c") failed: Property not found. retry in 754.822427ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
5652024-11-07T02:39:40.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5") failed: Property not found. retry in 1.322002865s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
5662024-11-07T02:39:40.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d") failed: Property not found. retry in 1.034314448s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
5672024-11-07T02:39:40.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c") failed: Property not found. retry in 1.236268128s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
5682024-11-07T02:39:41.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d") failed: Property not found. retry in 616.874499ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
5692024-11-07T02:39:42.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5") failed: Property not found. retry in 903.338336ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
5702024-11-07T02:39:42.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c") failed: Property not found. retry in 976.913682ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
5712024-11-07T02:39:42.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d") failed: Property not found. retry in 627.551943ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
5722024-11-07T02:39:43.196ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_7cfffa97-7a66-403f-8435-0f9efd5ce03d
5732024-11-07T02:39:43.196ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_66e6e8a1-7b35-4429-9278-b472618144c5
5742024-11-07T02:39:43.196ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_69f913d1-faa1-4ef2-b58b-1ff75217594c
5752024-11-07T02:39:43.196ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5762024-11-07T02:39:43.196ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5772024-11-07T02:39:43.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10289456 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47207 req_id = 5f596945-8cf1-4d17-8a7f-d2a147af438a response_code = 204 uri = /omicron-zones
5782024-11-07T02:39:43.198ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5792024-11-07T02:39:43.228ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 76.816473ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:596
5802024-11-07T02:39:43.305ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 113.382321ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:596
5812024-11-07T02:39:43.420ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 173.329575ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:596
5822024-11-07T02:39:43.594ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 198.366817ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:596
5832024-11-07T02:39:43.793ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 165.194275ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:596
5842024-11-07T02:39:43.960ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 295.230753ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:596
5852024-11-07T02:39:44.256ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 318.892646ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:596
5862024-11-07T02:39:44.695ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5872024-11-07T02:39:44.869ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5882024-11-07T02:39:45.101ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:612
5892024-11-07T02:39:45.101ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5902024-11-07T02:39:45.133ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5912024-11-07T02:39:45.134ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5922024-11-07T02:39:45.134ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5932024-11-07T02:39:45.163ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d (service), filesystem_pool: Some(ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 69f913d1-faa1-4ef2-b58b-1ff75217594c (service), filesystem_pool: Some(ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 66e6e8a1-7b35-4429-9278-b472618144c5 (service), filesystem_pool: Some(ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 91499dff-558f-45fd-82c1-c0162a3f31f8 (service), filesystem_pool: Some(ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7fb1bae0-6dab-449f-a3cc-327556fd4334, kind: Service { id: 91499dff-558f-45fd-82c1-c0162a3f31f8 }, name: Name("ntp-91499dff-558f-45fd-82c1-c0162a3f31f8"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 206])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
5942024-11-07T02:39:45.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56003
5952024-11-07T02:39:45.164ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5962024-11-07T02:39:45.164ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: InternalDns }, responder: ... }
5972024-11-07T02:39:45.257ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69f913d1-faa1-4ef2-b58b-1ff75217594c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5982024-11-07T02:39:45.257ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 69f913d1-faa1-4ef2-b58b-1ff75217594c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5992024-11-07T02:39:45.318ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 66e6e8a1-7b35-4429-9278-b472618144c5, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6002024-11-07T02:39:45.318ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 66e6e8a1-7b35-4429-9278-b472618144c5, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6012024-11-07T02:39:45.385ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6022024-11-07T02:39:45.385ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:177
6032024-11-07T02:39:45.385ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:177
6042024-11-07T02:39:45.385ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6052024-11-07T02:39:45.396ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
6062024-11-07T02:39:45.428ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
6072024-11-07T02:39:45.429ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
6082024-11-07T02:39:45.429ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
6092024-11-07T02:39:45.459ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 143, 206]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
6102024-11-07T02:39:45.459ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = boundary_ntp
6112024-11-07T02:39:45.459ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
6122024-11-07T02:39:45.459ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
6132024-11-07T02:39:45.459ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
6142024-11-07T02:39:45.461ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6152024-11-07T02:39:45.484ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8 file = illumos-utils/src/zone.rs:325
6162024-11-07T02:39:45.501ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8 file = illumos-utils/src/zone.rs:363
6172024-11-07T02:39:46.145ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6182024-11-07T02:39:46.145ZINFOSledAgent (ServiceManager): Booting oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6192024-11-07T02:39:46.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8") failed: Property not found. retry in 56.370541ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6202024-11-07T02:39:46.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8") failed: Property not found. retry in 144.611933ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6212024-11-07T02:39:46.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8") failed: Property not found. retry in 126.962007ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6222024-11-07T02:39:46.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8") failed: Property not found. retry in 305.959327ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6232024-11-07T02:39:46.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8") failed: Property not found. retry in 667.830599ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6242024-11-07T02:39:47.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8") failed: Property not found. retry in 638.623033ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6252024-11-07T02:39:48.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8") failed: Property not found. retry in 780.375843ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6262024-11-07T02:39:48.409ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9642745831105742236 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
6272024-11-07T02:39:48.409ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12731437480929874151 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
6282024-11-07T02:39:49.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8") failed: Property not found. retry in 959.365795ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6292024-11-07T02:39:49.114ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
6302024-11-07T02:39:49.114ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
6312024-11-07T02:39:50.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8") failed: Property not found. retry in 1.494069681s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6322024-11-07T02:39:51.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8") failed: Property not found. retry in 818.997296ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6332024-11-07T02:39:52.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8") failed: Property not found. retry in 1.21066718s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6342024-11-07T02:39:52.959ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16052657616678394022 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
6352024-11-07T02:39:53.194ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15830718383038487617 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
6362024-11-07T02:39:53.197ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1648351710561856759 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
6372024-11-07T02:39:53.612ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8
6382024-11-07T02:39:53.612ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6392024-11-07T02:39:53.612ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6402024-11-07T02:39:53.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8449343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56003 req_id = 5388f0be-b227-4374-9e85-cb88c59a31e1 response_code = 204 uri = /omicron-zones
6412024-11-07T02:39:53.615ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:653
6422024-11-07T02:39:53.644ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6432024-11-07T02:39:53.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61606
6442024-11-07T02:39:53.652ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6452024-11-07T02:39:53.652ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 7611 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61606 req_id = d0b1526f-2a6f-4af0-bf38-a96e5c718885 response_code = 500 uri = /timesync
6462024-11-07T02:39:53.655ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6472024-11-07T02:39:53.806ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6482024-11-07T02:39:53.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33942
6492024-11-07T02:39:57.814ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6502024-11-07T02:39:57.814ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4007918 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33942 req_id = 9db99230-daac-457b-929e-2a1def8e8d96 response_code = 500 uri = /timesync
6512024-11-07T02:39:57.816ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6522024-11-07T02:39:57.944ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6532024-11-07T02:39:57.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46773
6542024-11-07T02:39:57.953ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_91499dff-558f-45fd-82c1-c0162a3f31f8': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6552024-11-07T02:39:57.953ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8520 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46773 req_id = 006577e7-26a8-4a76-982c-da5fbb1e0028 response_code = 500 uri = /timesync
6562024-11-07T02:39:57.955ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6572024-11-07T02:39:58.105ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6582024-11-07T02:39:58.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35675
6592024-11-07T02:39:58.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35675 req_id = 97289b8e-d0ee-43f2-a0df-644dc5310227 response_code = 200 uri = /timesync
6602024-11-07T02:39:58.116ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6612024-11-07T02:39:58.116ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6622024-11-07T02:39:58.307ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6632024-11-07T02:39:58.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43884
6642024-11-07T02:39:58.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7871 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43884 req_id = 40184b1d-fbb9-487d-bed7-d2611e437f9b response_code = 200 uri = /timesync
6652024-11-07T02:39:58.318ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6662024-11-07T02:39:58.318ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6672024-11-07T02:39:58.412ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9642745831105742236 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
6682024-11-07T02:39:58.412ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12731437480929874151 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
6692024-11-07T02:39:58.543ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6702024-11-07T02:39:58.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58165
6712024-11-07T02:39:58.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58165 req_id = ba898594-fceb-4e45-8373-4cb67f70ad31 response_code = 200 uri = /timesync
6722024-11-07T02:39:58.552ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6732024-11-07T02:39:58.552ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6742024-11-07T02:39:58.845ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6752024-11-07T02:39:58.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53016
6762024-11-07T02:39:58.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53016 req_id = 9349e15b-2ae1-41b1-9b82-0b234540cd91 response_code = 200 uri = /timesync
6772024-11-07T02:39:58.855ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6782024-11-07T02:39:58.855ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6792024-11-07T02:39:59.117ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
6802024-11-07T02:39:59.117ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
6812024-11-07T02:39:59.251ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6822024-11-07T02:39:59.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36544
6832024-11-07T02:39:59.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8414 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36544 req_id = 93acc44d-640e-4500-b9fa-48f50a78336c response_code = 200 uri = /timesync
6842024-11-07T02:39:59.262ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6852024-11-07T02:39:59.262ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6862024-11-07T02:39:59.809ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6872024-11-07T02:39:59.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47358
6882024-11-07T02:40:00.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47358 req_id = 0ebbae0b-85b2-4032-8a44-2a93315736cd response_code = 200 uri = /timesync
6892024-11-07T02:40:00.008ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6902024-11-07T02:40:00.008ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6912024-11-07T02:40:00.453ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6922024-11-07T02:40:00.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42474
6932024-11-07T02:40:00.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8436 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42474 req_id = 785de5c2-540d-4a51-80f5-5f225784040e response_code = 200 uri = /timesync
6942024-11-07T02:40:00.464ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6952024-11-07T02:40:00.464ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6962024-11-07T02:40:00.900ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6972024-11-07T02:40:00.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55678
6982024-11-07T02:40:00.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7625 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55678 req_id = 90934df5-958f-48d4-8e7d-a90e1434231c response_code = 200 uri = /timesync
6992024-11-07T02:40:00.911ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
7002024-11-07T02:40:00.911ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7012024-11-07T02:40:01.242ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 203.106146ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7022024-11-07T02:40:01.507ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7032024-11-07T02:40:01.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34638
7042024-11-07T02:40:01.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7873 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34638 req_id = 40e5064c-4bf7-478b-b96b-6582f68b74f9 response_code = 200 uri = /timesync
7052024-11-07T02:40:01.517ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
7062024-11-07T02:40:01.517ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7072024-11-07T02:40:02.219ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7082024-11-07T02:40:02.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60337
7092024-11-07T02:40:02.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8666 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60337 req_id = 793a936c-1376-440f-93fa-04aa92b4f9d0 response_code = 200 uri = /timesync
7102024-11-07T02:40:02.230ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.323876292 } file = sled-agent/src/rack_setup/service.rs:661
7112024-11-07T02:40:02.230ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7122024-11-07T02:40:03.084ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16052657616678394022 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7132024-11-07T02:40:03.319ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15830718383038487617 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7142024-11-07T02:40:03.322ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1648351710561856759 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7152024-11-07T02:40:03.491ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7162024-11-07T02:40:03.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37587
7172024-11-07T02:40:03.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8775 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37587 req_id = c9153377-5261-4fe3-93ed-3760a4107678 response_code = 200 uri = /timesync
7182024-11-07T02:40:03.502ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.326933086 } file = sled-agent/src/rack_setup/service.rs:661
7192024-11-07T02:40:03.502ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7202024-11-07T02:40:03.737ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7727788648242072102 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7212024-11-07T02:40:03.737ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9656484995661661432 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7222024-11-07T02:40:04.314ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7232024-11-07T02:40:04.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35552
7242024-11-07T02:40:04.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8413 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35552 req_id = cf94e2a4-3545-48db-b2d0-05fe5b18a04c response_code = 200 uri = /timesync
7252024-11-07T02:40:04.325ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.318479747 } file = sled-agent/src/rack_setup/service.rs:661
7262024-11-07T02:40:04.325ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7272024-11-07T02:40:05.910ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7282024-11-07T02:40:05.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53985
7292024-11-07T02:40:05.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8727 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53985 req_id = 72ae8714-e3b8-4e52-bf64-963e87e57596 response_code = 200 uri = /timesync
7302024-11-07T02:40:05.921ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.308424562 } file = sled-agent/src/rack_setup/service.rs:661
7312024-11-07T02:40:05.921ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7322024-11-07T02:40:08.143ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7332024-11-07T02:40:08.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54881
7342024-11-07T02:40:08.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8610 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54881 req_id = bf24469c-790b-46b0-ac3c-3f6b77f12445 response_code = 200 uri = /timesync
7352024-11-07T02:40:08.155ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730947205.6446476, correction: -0.300670892 } file = sled-agent/src/rack_setup/service.rs:661
7362024-11-07T02:40:08.155ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7372024-11-07T02:40:08.208ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34087
7382024-11-07T02:40:08.208ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34087 req_id = 549b672a-e413-463c-8de0-3d2588985fb3 response_code = 200 uri = /baseboard
7392024-11-07T02:40:08.523ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9642745831105742236 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7402024-11-07T02:40:08.523ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12731437480929874151 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7412024-11-07T02:40:09.226ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7422024-11-07T02:40:09.226ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7432024-11-07T02:40:09.499ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7442024-11-07T02:40:09.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65300
7452024-11-07T02:40:09.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65300 req_id = 32afa365-ea2e-4b79-afd4-3b2a331d2f21 response_code = 200 uri = /timesync
7462024-11-07T02:40:09.510ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1730947208.0374928, correction: -0.297091395 } file = sled-agent/src/rack_setup/service.rs:661
7472024-11-07T02:40:09.510ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7482024-11-07T02:40:10.984ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7492024-11-07T02:40:10.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43379
7502024-11-07T02:40:10.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9068 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43379 req_id = 3da8bf21-2f56-46c5-824c-ff2d8af2ee99 response_code = 200 uri = /timesync
7512024-11-07T02:40:10.995ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1730947209.6408424, correction: -0.292601079 } file = sled-agent/src/rack_setup/service.rs:661
7522024-11-07T02:40:10.995ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7532024-11-07T02:40:13.060ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16052657616678394022 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7542024-11-07T02:40:13.293ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15830718383038487617 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7552024-11-07T02:40:13.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1648351710561856759 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7562024-11-07T02:40:13.485ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7572024-11-07T02:40:13.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59044
7582024-11-07T02:40:13.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9029 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59044 req_id = 03f5b0be-2c42-4c21-9ab2-173f63098849 response_code = 200 uri = /timesync
7592024-11-07T02:40:13.496ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947212.5443192, correction: -0.28586939 } file = sled-agent/src/rack_setup/service.rs:661
7602024-11-07T02:40:13.496ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7612024-11-07T02:40:13.712ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7727788648242072102 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7622024-11-07T02:40:13.712ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9656484995661661432 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7632024-11-07T02:40:16.442ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 510.366414ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7642024-11-07T02:40:17.269ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7652024-11-07T02:40:17.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57304
7662024-11-07T02:40:17.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8916 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57304 req_id = a9b8fc9e-d98c-430b-b073-f9821d841b32 response_code = 200 uri = /timesync
7672024-11-07T02:40:17.282ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947214.336656, correction: -0.275579572 } file = sled-agent/src/rack_setup/service.rs:661
7682024-11-07T02:40:17.282ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7692024-11-07T02:40:18.499ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9642745831105742236 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7702024-11-07T02:40:18.499ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12731437480929874151 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7712024-11-07T02:40:19.201ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7722024-11-07T02:40:19.201ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7732024-11-07T02:40:22.164ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7742024-11-07T02:40:22.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63349
7752024-11-07T02:40:22.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9478 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63349 req_id = 0a9f06cd-3013-4549-a0ab-8ca2fd600666 response_code = 200 uri = /timesync
7762024-11-07T02:40:22.176ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947220.8343074, correction: -0.262442261 } file = sled-agent/src/rack_setup/service.rs:661
7772024-11-07T02:40:22.176ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7782024-11-07T02:40:23.034ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16052657616678394022 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7792024-11-07T02:40:23.267ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15830718383038487617 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7802024-11-07T02:40:23.271ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1648351710561856759 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7812024-11-07T02:40:23.686ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7727788648242072102 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7822024-11-07T02:40:23.687ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9656484995661661432 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7832024-11-07T02:40:24.653ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7842024-11-07T02:40:24.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60753
7852024-11-07T02:40:24.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8742 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60753 req_id = 3d6ead31-9739-434a-b32e-2dbf6771b5bc response_code = 200 uri = /timesync
7862024-11-07T02:40:24.666ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947223.014946, correction: -0.255645007 } file = sled-agent/src/rack_setup/service.rs:661
7872024-11-07T02:40:24.666ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7882024-11-07T02:40:27.507ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7892024-11-07T02:40:27.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47769
7902024-11-07T02:40:27.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8946 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47769 req_id = 1b488c80-1f5a-4c9c-aea2-3d7b3be857b0 response_code = 200 uri = /timesync
7912024-11-07T02:40:27.518ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947225.9625633, correction: -0.248206407 } file = sled-agent/src/rack_setup/service.rs:661
7922024-11-07T02:40:27.518ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7932024-11-07T02:40:28.474ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9642745831105742236 reason = Duration(60s) sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7942024-11-07T02:40:28.475ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12731437480929874151 reason = Duration(60s) sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7952024-11-07T02:40:29.177ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7962024-11-07T02:40:29.177ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7972024-11-07T02:40:31.946ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.445019259s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7982024-11-07T02:40:33.009ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16052657616678394022 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
7992024-11-07T02:40:33.242ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15830718383038487617 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8002024-11-07T02:40:33.245ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1648351710561856759 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8012024-11-07T02:40:33.654ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8022024-11-07T02:40:33.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61225
8032024-11-07T02:40:33.661ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7727788648242072102 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8042024-11-07T02:40:33.661ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9656484995661661432 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8052024-11-07T02:40:33.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9873 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61225 req_id = d74f8cdb-9a72-4de1-b659-2c60f3f75044 response_code = 200 uri = /timesync
8062024-11-07T02:40:33.667ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947232.891694, correction: -0.231914476 } file = sled-agent/src/rack_setup/service.rs:661
8072024-11-07T02:40:33.667ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8082024-11-07T02:40:38.159ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42199
8092024-11-07T02:40:38.159ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42199 req_id = c3e872f7-d36b-454a-a20e-64dadec38ee2 response_code = 200 uri = /baseboard
8102024-11-07T02:40:39.152ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8112024-11-07T02:40:39.152ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8122024-11-07T02:40:42.985ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16052657616678394022 reason = Duration(60s) sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8132024-11-07T02:40:43.216ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15830718383038487617 reason = Duration(60s) sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8142024-11-07T02:40:43.221ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1648351710561856759 reason = Duration(60s) sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8152024-11-07T02:40:43.635ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7727788648242072102 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8162024-11-07T02:40:43.636ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9656484995661661432 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8172024-11-07T02:40:45.195ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8182024-11-07T02:40:45.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43244
8192024-11-07T02:40:45.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8762 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43244 req_id = 62ad2aab-8bea-455d-9dee-a41875438e96 response_code = 200 uri = /timesync
8202024-11-07T02:40:45.206ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947243.3255787, correction: -0.201149032 } file = sled-agent/src/rack_setup/service.rs:661
8212024-11-07T02:40:45.206ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8222024-11-07T02:40:48.380ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.543204956s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8232024-11-07T02:40:49.128ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8242024-11-07T02:40:49.128ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8252024-11-07T02:40:51.222ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8262024-11-07T02:40:51.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32793
8272024-11-07T02:40:51.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9023 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32793 req_id = 8e00b08f-9e1f-45db-b0e5-84044ce11675 response_code = 200 uri = /timesync
8282024-11-07T02:40:51.234ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947248.8412466, correction: -0.185058042 } file = sled-agent/src/rack_setup/service.rs:661
8292024-11-07T02:40:51.234ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8302024-11-07T02:40:53.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7727788648242072102 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8312024-11-07T02:40:53.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9656484995661661432 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8322024-11-07T02:40:59.103ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8332024-11-07T02:40:59.104ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8342024-11-07T02:41:03.595ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8352024-11-07T02:41:03.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60857
8362024-11-07T02:41:03.600ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7727788648242072102 reason = Duration(60s) sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8372024-11-07T02:41:03.602ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9656484995661661432 reason = Duration(60s) sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8382024-11-07T02:41:03.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9933 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60857 req_id = d42e5e2c-3ab6-4a4c-982b-d3aaeeec5932 response_code = 200 uri = /timesync
8392024-11-07T02:41:03.608ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947260.7102666, correction: -0.151498049 } file = sled-agent/src/rack_setup/service.rs:661
8402024-11-07T02:41:03.608ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8412024-11-07T02:41:04.914ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.653441219s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8422024-11-07T02:41:08.111ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54620
8432024-11-07T02:41:08.111ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54620 req_id = f9a51b21-8d3f-4cad-a1b1-03c1e673faba response_code = 200 uri = /baseboard
8442024-11-07T02:41:09.078ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8452024-11-07T02:41:09.078ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8462024-11-07T02:41:10.860ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8472024-11-07T02:41:10.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58241
8482024-11-07T02:41:10.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8962 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58241 req_id = fd77eb02-59d1-4b83-822e-ca0cf3c63aaf response_code = 200 uri = /timesync
8492024-11-07T02:41:10.873ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947264.7398748, correction: -0.131221816 } file = sled-agent/src/rack_setup/service.rs:661
8502024-11-07T02:41:10.873ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8512024-11-07T02:41:19.053ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8522024-11-07T02:41:19.053ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8532024-11-07T02:41:21.490ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8542024-11-07T02:41:21.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53453
8552024-11-07T02:41:21.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9048 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53453 req_id = 8f10f4bf-1a66-487d-892a-7746492036ce response_code = 200 uri = /timesync
8562024-11-07T02:41:21.502ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947273.464061, correction: -0.102518536 } file = sled-agent/src/rack_setup/service.rs:661
8572024-11-07T02:41:21.502ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8582024-11-07T02:41:23.552ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.870438856s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8592024-11-07T02:41:29.028ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8602024-11-07T02:41:29.029ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8612024-11-07T02:41:37.368ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8622024-11-07T02:41:37.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38182
8632024-11-07T02:41:37.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8820 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38182 req_id = a2291a4a-7588-4e1f-983b-cae0bd0158fb response_code = 200 uri = /timesync
8642024-11-07T02:41:37.380ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947281.4918933, correction: -0.059596922 } file = sled-agent/src/rack_setup/service.rs:661
8652024-11-07T02:41:37.380ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8662024-11-07T02:41:38.064ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65194
8672024-11-07T02:41:38.064ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65194 req_id = a2e45c19-730b-405d-a263-8b6da3e1cc4a response_code = 200 uri = /baseboard
8682024-11-07T02:41:39.004ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8692024-11-07T02:41:39.004ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8702024-11-07T02:41:45.399ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 22.293973924s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8712024-11-07T02:41:48.979ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8722024-11-07T02:41:48.979ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8732024-11-07T02:41:58.959ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15490798114643149979 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8742024-11-07T02:41:58.960ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3856556876074494927 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8752024-11-07T02:42:07.266ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8762024-11-07T02:42:07.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63160
8772024-11-07T02:42:07.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 20509 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63160 req_id = 90481636-a6d0-4842-bc0d-76c0a8aeb3a2 response_code = 200 uri = /timesync
8782024-11-07T02:42:07.287ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-07T02:41:03.600856507Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7727788648242072102 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8792024-11-07T02:42:07.289ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-07T02:40:43.221008956Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1648351710561856759 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8802024-11-07T02:42:07.289ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-07T02:40:28.474859128Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9642745831105742236 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8812024-11-07T02:42:07.290ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-07T02:40:28.475603551Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12731437480929874151 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8822024-11-07T02:42:07.290ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-07T02:40:42.985273639Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16052657616678394022 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8832024-11-07T02:42:07.290ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-07T02:41:03.602646647Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9656484995661661432 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8842024-11-07T02:42:07.290ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-07T02:40:43.216595543Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15830718383038487617 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
8852024-11-07T02:42:07.290ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1730947321.8742092, correction: -0.001557001 } file = sled-agent/src/rack_setup/service.rs:661
8862024-11-07T02:42:07.290ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1308
8872024-11-07T02:42:07.320ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d (service), filesystem_pool: Some(ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 69f913d1-faa1-4ef2-b58b-1ff75217594c (service), filesystem_pool: Some(ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 66e6e8a1-7b35-4429-9278-b472618144c5 (service), filesystem_pool: Some(ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 91499dff-558f-45fd-82c1-c0162a3f31f8 (service), filesystem_pool: Some(ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7fb1bae0-6dab-449f-a3cc-327556fd4334, kind: Service { id: 91499dff-558f-45fd-82c1-c0162a3f31f8 }, name: Name("ntp-91499dff-558f-45fd-82c1-c0162a3f31f8"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 206])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3e2a0dc4-b384-487a-97a1-1a022b1fbd95 (service), filesystem_pool: Some(ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External } } } }, OmicronZoneConfig { id: 5cd925db-2f32-44f2-b711-d81b28c4ad49 (service), filesystem_pool: Some(ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External } } } }, OmicronZoneConfig { id: 02d93e5c-5942-4e35-bf44-c71f5c06b0e6 (service), filesystem_pool: Some(ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External } } } }, OmicronZoneConfig { id: 963b7a8f-421c-4bfb-982a-f774117740e2 (service), filesystem_pool: Some(ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External } } } }, OmicronZoneConfig { id: b9966e90-a62d-4800-a5a5-d9949e70e7a0 (service), filesystem_pool: Some(ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
8882024-11-07T02:42:07.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49524
8892024-11-07T02:42:07.320ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8902024-11-07T02:42:07.320ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: InternalDns }, responder: ... }
8912024-11-07T02:42:07.355ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69f913d1-faa1-4ef2-b58b-1ff75217594c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8922024-11-07T02:42:07.355ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 69f913d1-faa1-4ef2-b58b-1ff75217594c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8932024-11-07T02:42:07.392ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 66e6e8a1-7b35-4429-9278-b472618144c5, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8942024-11-07T02:42:07.392ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 66e6e8a1-7b35-4429-9278-b472618144c5, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8952024-11-07T02:42:07.425ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3e2a0dc4-b384-487a-97a1-1a022b1fbd95, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8962024-11-07T02:42:07.425ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3e2a0dc4-b384-487a-97a1-1a022b1fbd95, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: Cockroach }, responder: ... }
8972024-11-07T02:42:07.486ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5cd925db-2f32-44f2-b711-d81b28c4ad49, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8982024-11-07T02:42:07.486ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 5cd925db-2f32-44f2-b711-d81b28c4ad49, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8992024-11-07T02:42:07.545ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 02d93e5c-5942-4e35-bf44-c71f5c06b0e6, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9002024-11-07T02:42:07.546ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 02d93e5c-5942-4e35-bf44-c71f5c06b0e6, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9012024-11-07T02:42:07.604ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 963b7a8f-421c-4bfb-982a-f774117740e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9022024-11-07T02:42:07.604ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 963b7a8f-421c-4bfb-982a-f774117740e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9032024-11-07T02:42:07.667ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b9966e90-a62d-4800-a5a5-d9949e70e7a0, dataset_name: DatasetName { pool_name: ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9042024-11-07T02:42:07.667ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: b9966e90-a62d-4800-a5a5-d9949e70e7a0, dataset_name: DatasetName { pool_name: ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9052024-11-07T02:42:07.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9062024-11-07T02:42:07.727ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:177
9072024-11-07T02:42:07.728ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:177
9082024-11-07T02:42:07.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9092024-11-07T02:42:07.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9102024-11-07T02:42:07.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9112024-11-07T02:42:07.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9122024-11-07T02:42:07.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9132024-11-07T02:42:07.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9142024-11-07T02:42:07.905ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95 file = illumos-utils/src/zone.rs:325
9152024-11-07T02:42:07.910ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6 file = illumos-utils/src/zone.rs:325
9162024-11-07T02:42:07.914ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0 file = illumos-utils/src/zone.rs:325
9172024-11-07T02:42:07.919ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2 file = illumos-utils/src/zone.rs:325
9182024-11-07T02:42:07.924ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49 file = illumos-utils/src/zone.rs:325
9192024-11-07T02:42:07.929ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95 file = illumos-utils/src/zone.rs:363
9202024-11-07T02:42:07.934ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6 file = illumos-utils/src/zone.rs:363
9212024-11-07T02:42:07.939ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0 file = illumos-utils/src/zone.rs:363
9222024-11-07T02:42:07.944ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2 file = illumos-utils/src/zone.rs:363
9232024-11-07T02:42:07.948ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49 file = illumos-utils/src/zone.rs:363
9242024-11-07T02:42:08.057ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37448
9252024-11-07T02:42:08.058ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37448 req_id = 6cf4b2e0-47a7-40ee-9011-3686048782fc response_code = 200 uri = /baseboard
9262024-11-07T02:42:10.828ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3e2a0dc4-b384-487a-97a1-1a022b1fbd95'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9272024-11-07T02:42:10.828ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9282024-11-07T02:42:10.846ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='963b7a8f-421c-4bfb-982a-f774117740e2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9292024-11-07T02:42:10.846ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9302024-11-07T02:42:10.897ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5cd925db-2f32-44f2-b711-d81b28c4ad49'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9312024-11-07T02:42:10.898ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9322024-11-07T02:42:10.909ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='02d93e5c-5942-4e35-bf44-c71f5c06b0e6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9332024-11-07T02:42:10.909ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9342024-11-07T02:42:10.951ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b9966e90-a62d-4800-a5a5-d9949e70e7a0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9352024-11-07T02:42:10.951ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9362024-11-07T02:42:10.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 41.504672ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9372024-11-07T02:42:10.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 66.418102ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9382024-11-07T02:42:11.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 68.927081ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9392024-11-07T02:42:11.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49") failed: Property not found. retry in 46.484095ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9402024-11-07T02:42:11.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 128.264672ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9412024-11-07T02:42:11.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 37.261849ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9422024-11-07T02:42:11.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 140.544913ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9432024-11-07T02:42:12.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 429.742247ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9442024-11-07T02:42:12.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 62.071794ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9452024-11-07T02:42:12.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 33.81803ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9462024-11-07T02:42:13.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 115.147121ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9472024-11-07T02:42:13.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49") failed: Property not found. retry in 142.406433ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9482024-11-07T02:42:13.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 1.197780251s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9492024-11-07T02:42:13.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 168.881246ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9502024-11-07T02:42:13.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 116.140279ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9512024-11-07T02:42:13.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 342.86941ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9522024-11-07T02:42:13.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49") failed: Property not found. retry in 279.489431ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9532024-11-07T02:42:13.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 270.171875ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9542024-11-07T02:42:13.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 558.472125ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9552024-11-07T02:42:13.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49") failed: Property not found. retry in 567.035704ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9562024-11-07T02:42:13.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 246.843994ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9572024-11-07T02:42:13.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 1.15139163s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9582024-11-07T02:42:13.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 1.061596935s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9592024-11-07T02:42:13.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 768.76946ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9602024-11-07T02:42:14.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49") failed: Property not found. retry in 994.259361ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9612024-11-07T02:42:14.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 1.21672268s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9622024-11-07T02:42:14.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 1.158680447s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9632024-11-07T02:42:14.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 539.04545ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9642024-11-07T02:42:14.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 1.305104033s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9652024-11-07T02:42:15.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49") failed: Property not found. retry in 920.762959ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9662024-11-07T02:42:15.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 643.227207ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9672024-11-07T02:42:15.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 504.061385ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9682024-11-07T02:42:15.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 1.377069275s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9692024-11-07T02:42:15.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 1.240551652s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9702024-11-07T02:42:16.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49") failed: Property not found. retry in 894.112152ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9712024-11-07T02:42:16.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 630.056346ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9722024-11-07T02:42:16.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 1.222453004s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9732024-11-07T02:42:16.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 1.109894428s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9742024-11-07T02:42:16.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49") failed: Property not found. retry in 1.077715616s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9752024-11-07T02:42:17.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 1.295188669s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9762024-11-07T02:42:17.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 580.910205ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9772024-11-07T02:42:17.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 1.072112628s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9782024-11-07T02:42:17.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 822.575844ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9792024-11-07T02:42:17.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 687.877978ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9802024-11-07T02:42:18.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49") failed: Property not found. retry in 633.219357ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9812024-11-07T02:42:18.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 831.166404ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9822024-11-07T02:42:18.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 1.146899046s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9832024-11-07T02:42:18.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 1.134587915s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9842024-11-07T02:42:18.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 1.293021954s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9852024-11-07T02:42:18.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49") failed: Property not found. retry in 1.193906501s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9862024-11-07T02:42:19.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 1.311714708s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9872024-11-07T02:42:19.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 663.799645ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9882024-11-07T02:42:19.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 1.167548834s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9892024-11-07T02:42:19.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49") failed: Property not found. retry in 1.201319438s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
9902024-11-07T02:42:19.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 633.725624ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9912024-11-07T02:42:20.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 1.122080444s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9922024-11-07T02:42:20.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 860.612869ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9932024-11-07T02:42:20.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2") failed: Property not found. retry in 1.094402184s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
9942024-11-07T02:42:20.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95") failed: Property not found. retry in 1.318491459s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
9952024-11-07T02:42:21.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 572.757947ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9962024-11-07T02:42:21.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 1.116164403s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9972024-11-07T02:42:22.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 951.143685ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
9982024-11-07T02:42:22.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 840.6629ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
9992024-11-07T02:42:22.703ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 30.593748145s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
10002024-11-07T02:42:23.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 1.134127269s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
10012024-11-07T02:42:23.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 1.065685699s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
10022024-11-07T02:42:24.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 1.084908522s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
10032024-11-07T02:42:24.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 804.110656ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
10042024-11-07T02:42:25.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 1.156501952s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
10052024-11-07T02:42:25.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 1.451693191s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
10062024-11-07T02:42:26.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 1.293359272s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
10072024-11-07T02:42:27.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 1.410550945s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
10082024-11-07T02:42:27.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 741.054149ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
10092024-11-07T02:42:28.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 761.514522ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
10102024-11-07T02:42:28.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 539.322596ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
10112024-11-07T02:42:29.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 998.693095ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
10122024-11-07T02:42:29.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 501.483841ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
10132024-11-07T02:42:29.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 1.102081721s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
10142024-11-07T02:42:30.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6") failed: Property not found. retry in 1.419731956s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
10152024-11-07T02:42:30.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0") failed: Property not found. retry in 810.601259ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
10162024-11-07T02:42:31.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_3e2a0dc4-b384-487a-97a1-1a022b1fbd95
10172024-11-07T02:42:31.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_02d93e5c-5942-4e35-bf44-c71f5c06b0e6
10182024-11-07T02:42:31.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_b9966e90-a62d-4800-a5a5-d9949e70e7a0
10192024-11-07T02:42:31.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_963b7a8f-421c-4bfb-982a-f774117740e2
10202024-11-07T02:42:31.687ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_5cd925db-2f32-44f2-b711-d81b28c4ad49
10212024-11-07T02:42:31.687ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10222024-11-07T02:42:31.688ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10232024-11-07T02:42:31.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 24368957 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49524 req_id = a27e62bd-66a1-4c8f-bebb-3e332d3c198d response_code = 204 uri = /omicron-zones
10242024-11-07T02:42:31.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62705
10252024-11-07T02:42:31.752ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3706
10262024-11-07T02:42:36.242ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3724
10272024-11-07T02:42:39.096ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3747
10282024-11-07T02:42:39.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7372046 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62705 req_id = 0a0a82f6-d97c-4e52-84df-d57b797da0bc response_code = 204 uri = /cockroachdb
10292024-11-07T02:42:39.096ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42282
10302024-11-07T02:42:39.097ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42282 req_id = 16e4e30b-27ad-4b89-b000-d8253a29c2c0 response_code = 200 uri = /baseboard
10312024-11-07T02:42:39.134ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d (service), filesystem_pool: Some(ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 69f913d1-faa1-4ef2-b58b-1ff75217594c (service), filesystem_pool: Some(ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 66e6e8a1-7b35-4429-9278-b472618144c5 (service), filesystem_pool: Some(ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 91499dff-558f-45fd-82c1-c0162a3f31f8 (service), filesystem_pool: Some(ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7fb1bae0-6dab-449f-a3cc-327556fd4334, kind: Service { id: 91499dff-558f-45fd-82c1-c0162a3f31f8 }, name: Name("ntp-91499dff-558f-45fd-82c1-c0162a3f31f8"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 206])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3e2a0dc4-b384-487a-97a1-1a022b1fbd95 (service), filesystem_pool: Some(ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External } } } }, OmicronZoneConfig { id: 5cd925db-2f32-44f2-b711-d81b28c4ad49 (service), filesystem_pool: Some(ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External } } } }, OmicronZoneConfig { id: 02d93e5c-5942-4e35-bf44-c71f5c06b0e6 (service), filesystem_pool: Some(ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External } } } }, OmicronZoneConfig { id: 963b7a8f-421c-4bfb-982a-f774117740e2 (service), filesystem_pool: Some(ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External } } } }, OmicronZoneConfig { id: b9966e90-a62d-4800-a5a5-d9949e70e7a0 (service), filesystem_pool: Some(ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External } } } }, OmicronZoneConfig { id: f2257614-9856-4344-bdd9-897edf2a5e03 (service), filesystem_pool: Some(ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: b0270c81-c1ae-4f80-b64a-fc343b0f5d05, kind: Service { id: f2257614-9856-4344-bdd9-897edf2a5e03 }, name: Name("external-dns-f2257614-9856-4344-bdd9-897edf2a5e03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 (service), filesystem_pool: Some(ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 6e6dcf98-e56c-4c04-9515-6f635bc8207c, kind: Service { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 }, name: Name("external-dns-81e03cb2-6bdf-4324-a5c8-541c23e034b9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 (service), filesystem_pool: Some(ZpoolName { id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 639dd02e-77b1-44c5-bb10-e9604a99b455, kind: Service { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 }, name: Name("nexus-0d502811-de24-4e27-b92c-fccb5bf9f798"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 (service), filesystem_pool: Some(ZpoolName { id: 01d7d0b3-ada7-4e85-a6b4-686ef3c7940e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 5babe071-e49d-4d68-8a86-a6faf41174c4, kind: Service { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 }, name: Name("nexus-585aaa98-c3b7-4a1f-979c-2088fe719dd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: cfce6b5d-973c-4736-93fb-e3347600566b (service), filesystem_pool: Some(ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: a5ae62a3-3cee-4a00-a285-de4030662fb7, kind: Service { id: cfce6b5d-973c-4736-93fb-e3347600566b }, name: Name("nexus-cfce6b5d-973c-4736-93fb-e3347600566b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: b018a048-2a68-4115-9eeb-3b78701e4f51 (service), filesystem_pool: Some(ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 2ace40de-e863-410c-83ad-f114661d380a (service), filesystem_pool: Some(ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External } } } }, OmicronZoneConfig { id: d0c3cf40-824d-4318-b4c1-a2d226c53eb0 (service), filesystem_pool: Some(ZpoolName { id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 6645e1a6-5f27-4997-a3fa-4439c3e7f891 (service), filesystem_pool: Some(ZpoolName { id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 5d010780-78d0-42d7-ad02-0127a9078582 (service), filesystem_pool: Some(ZpoolName { id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: b0c601a1-7d97-4f06-87d6-e780c076d253 (service), filesystem_pool: Some(ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External } } } }, OmicronZoneConfig { id: 3c2cbf43-20e6-448e-9f34-069f41bf88a4 (service), filesystem_pool: Some(ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0786ea6b-a214-47e7-9492-8bd8c5985f0f (service), filesystem_pool: Some(ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed (service), filesystem_pool: Some(ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 222da6cf-e73a-4afd-a13f-39acf5585677 (service), filesystem_pool: Some(ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External } } } }, OmicronZoneConfig { id: c66c4807-87bf-49f2-97cb-31d8d688e481 (service), filesystem_pool: Some(ZpoolName { id: dddcfc0e-109d-4074-b924-e7a90aa78ab4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dddcfc0e-109d-4074-b924-e7a90aa78ab4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 43c763f8-8d01-40d7-9e52-7b33ee7e177c (service), filesystem_pool: Some(ZpoolName { id: 93fe9b26-7c2f-4e28-82f2-0a5320409e66 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93fe9b26-7c2f-4e28-82f2-0a5320409e66 (zpool), kind: External } } } }, OmicronZoneConfig { id: ab506eeb-498b-4eb1-8da1-5259c9538f51 (service), filesystem_pool: Some(ZpoolName { id: 01d7d0b3-ada7-4e85-a6b4-686ef3c7940e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01d7d0b3-ada7-4e85-a6b4-686ef3c7940e (zpool), kind: External } } } }, OmicronZoneConfig { id: cf4c1888-20dd-44c7-845e-3841aa76d3b8 (service), filesystem_pool: Some(ZpoolName { id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
10322024-11-07T02:42:39.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52269
10332024-11-07T02:42:39.135ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10342024-11-07T02:42:39.135ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 7cfffa97-7a66-403f-8435-0f9efd5ce03d, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: InternalDns }, responder: ... }
10352024-11-07T02:42:39.182ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69f913d1-faa1-4ef2-b58b-1ff75217594c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10362024-11-07T02:42:39.182ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 69f913d1-faa1-4ef2-b58b-1ff75217594c, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10372024-11-07T02:42:39.227ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 66e6e8a1-7b35-4429-9278-b472618144c5, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10382024-11-07T02:42:39.227ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 66e6e8a1-7b35-4429-9278-b472618144c5, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10392024-11-07T02:42:39.278ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3e2a0dc4-b384-487a-97a1-1a022b1fbd95, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10402024-11-07T02:42:39.278ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3e2a0dc4-b384-487a-97a1-1a022b1fbd95, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: Cockroach }, responder: ... }
10412024-11-07T02:42:39.323ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5cd925db-2f32-44f2-b711-d81b28c4ad49, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10422024-11-07T02:42:39.323ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 5cd925db-2f32-44f2-b711-d81b28c4ad49, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10432024-11-07T02:42:39.361ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 02d93e5c-5942-4e35-bf44-c71f5c06b0e6, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10442024-11-07T02:42:39.361ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 02d93e5c-5942-4e35-bf44-c71f5c06b0e6, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10452024-11-07T02:42:39.402ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 963b7a8f-421c-4bfb-982a-f774117740e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10462024-11-07T02:42:39.402ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 963b7a8f-421c-4bfb-982a-f774117740e2, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10472024-11-07T02:42:39.442ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b9966e90-a62d-4800-a5a5-d9949e70e7a0, dataset_name: DatasetName { pool_name: ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10482024-11-07T02:42:39.442ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: b9966e90-a62d-4800-a5a5-d9949e70e7a0, dataset_name: DatasetName { pool_name: ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10492024-11-07T02:42:39.485ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f2257614-9856-4344-bdd9-897edf2a5e03, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10502024-11-07T02:42:39.485ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f2257614-9856-4344-bdd9-897edf2a5e03, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10512024-11-07T02:42:39.556ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10522024-11-07T02:42:39.556ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10532024-11-07T02:42:39.626ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2ace40de-e863-410c-83ad-f114661d380a, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:451
10542024-11-07T02:42:39.626ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2ace40de-e863-410c-83ad-f114661d380a, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10552024-11-07T02:42:39.692ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b0c601a1-7d97-4f06-87d6-e780c076d253, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10562024-11-07T02:42:39.692ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: b0c601a1-7d97-4f06-87d6-e780c076d253, dataset_name: DatasetName { pool_name: ZpoolName { id: 54f9243c-18e6-42c9-935c-0dc4151c5bea (zpool), kind: External }, kind: Crucible }, responder: ... }
10572024-11-07T02:42:39.748ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c2cbf43-20e6-448e-9f34-069f41bf88a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10582024-11-07T02:42:39.748ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3c2cbf43-20e6-448e-9f34-069f41bf88a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 1e683710-2494-4ab1-a637-7b528e143c16 (zpool), kind: External }, kind: Crucible }, responder: ... }
10592024-11-07T02:42:39.836ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0786ea6b-a214-47e7-9492-8bd8c5985f0f, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10602024-11-07T02:42:39.836ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 0786ea6b-a214-47e7-9492-8bd8c5985f0f, dataset_name: DatasetName { pool_name: ZpoolName { id: e6e52c0a-a969-4298-91e8-02888028eb67 (zpool), kind: External }, kind: Crucible }, responder: ... }
10612024-11-07T02:42:39.922ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10622024-11-07T02:42:39.922ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed, dataset_name: DatasetName { pool_name: ZpoolName { id: 9ad521f2-498d-459f-9590-bf571f0f7fe6 (zpool), kind: External }, kind: Crucible }, responder: ... }
10632024-11-07T02:42:39.993ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 222da6cf-e73a-4afd-a13f-39acf5585677, dataset_name: DatasetName { pool_name: ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10642024-11-07T02:42:39.993ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 222da6cf-e73a-4afd-a13f-39acf5585677, dataset_name: DatasetName { pool_name: ZpoolName { id: 7779de2f-377d-433e-9f3f-656a23324b51 (zpool), kind: External }, kind: Crucible }, responder: ... }
10652024-11-07T02:42:40.060ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c66c4807-87bf-49f2-97cb-31d8d688e481, dataset_name: DatasetName { pool_name: ZpoolName { id: dddcfc0e-109d-4074-b924-e7a90aa78ab4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10662024-11-07T02:42:40.060ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: c66c4807-87bf-49f2-97cb-31d8d688e481, dataset_name: DatasetName { pool_name: ZpoolName { id: dddcfc0e-109d-4074-b924-e7a90aa78ab4 (zpool), kind: External }, kind: Crucible }, responder: ... }
10672024-11-07T02:42:40.129ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 43c763f8-8d01-40d7-9e52-7b33ee7e177c, dataset_name: DatasetName { pool_name: ZpoolName { id: 93fe9b26-7c2f-4e28-82f2-0a5320409e66 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10682024-11-07T02:42:40.129ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 43c763f8-8d01-40d7-9e52-7b33ee7e177c, dataset_name: DatasetName { pool_name: ZpoolName { id: 93fe9b26-7c2f-4e28-82f2-0a5320409e66 (zpool), kind: External }, kind: Crucible }, responder: ... }
10692024-11-07T02:42:40.197ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ab506eeb-498b-4eb1-8da1-5259c9538f51, dataset_name: DatasetName { pool_name: ZpoolName { id: 01d7d0b3-ada7-4e85-a6b4-686ef3c7940e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10702024-11-07T02:42:40.197ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: ab506eeb-498b-4eb1-8da1-5259c9538f51, dataset_name: DatasetName { pool_name: ZpoolName { id: 01d7d0b3-ada7-4e85-a6b4-686ef3c7940e (zpool), kind: External }, kind: Crucible }, responder: ... }
10712024-11-07T02:42:40.262ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cf4c1888-20dd-44c7-845e-3841aa76d3b8, dataset_name: DatasetName { pool_name: ZpoolName { id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10722024-11-07T02:42:40.262ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: cf4c1888-20dd-44c7-845e-3841aa76d3b8, dataset_name: DatasetName { pool_name: ZpoolName { id: 655eee30-398b-4d0f-848d-1f66d242e6b9 (zpool), kind: External }, kind: Crucible }, responder: ... }
10732024-11-07T02:42:40.331ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10742024-11-07T02:42:40.331ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:177
10752024-11-07T02:42:40.332ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:177
10762024-11-07T02:42:40.332ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10772024-11-07T02:42:40.435ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10782024-11-07T02:42:40.451ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10792024-11-07T02:42:40.451ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10802024-11-07T02:42:40.451ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10812024-11-07T02:42:40.490ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10822024-11-07T02:42:40.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10832024-11-07T02:42:40.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10842024-11-07T02:42:40.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10852024-11-07T02:42:40.503ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10862024-11-07T02:42:40.528ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10872024-11-07T02:42:40.528ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10882024-11-07T02:42:40.706ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10892024-11-07T02:42:40.706ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10902024-11-07T02:42:40.706ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10912024-11-07T02:42:40.706ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10922024-11-07T02:42:40.732ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10932024-11-07T02:42:40.732ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10942024-11-07T02:42:40.732ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10952024-11-07T02:42:40.732ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10962024-11-07T02:42:40.733ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4 file = illumos-utils/src/zone.rs:325
10972024-11-07T02:42:40.739ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0 file = illumos-utils/src/zone.rs:325
10982024-11-07T02:42:40.743ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891 file = illumos-utils/src/zone.rs:325
10992024-11-07T02:42:40.748ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed file = illumos-utils/src/zone.rs:325
11002024-11-07T02:42:40.753ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253 file = illumos-utils/src/zone.rs:325
11012024-11-07T02:42:40.759ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677 file = illumos-utils/src/zone.rs:325
11022024-11-07T02:42:40.763ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a file = illumos-utils/src/zone.rs:325
11032024-11-07T02:42:40.899ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4 file = illumos-utils/src/zone.rs:363
11042024-11-07T02:42:40.903ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0 file = illumos-utils/src/zone.rs:363
11052024-11-07T02:42:40.908ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891 file = illumos-utils/src/zone.rs:363
11062024-11-07T02:42:40.913ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed file = illumos-utils/src/zone.rs:363
11072024-11-07T02:42:40.917ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253 file = illumos-utils/src/zone.rs:363
11082024-11-07T02:42:40.922ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677 file = illumos-utils/src/zone.rs:363
11092024-11-07T02:42:40.927ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a file = illumos-utils/src/zone.rs:363
11102024-11-07T02:42:40.933ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c file = illumos-utils/src/zone.rs:325
11112024-11-07T02:42:40.938ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481 file = illumos-utils/src/zone.rs:325
11122024-11-07T02:42:40.944ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51 file = illumos-utils/src/zone.rs:325
11132024-11-07T02:42:40.950ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f file = illumos-utils/src/zone.rs:325
11142024-11-07T02:42:40.956ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8 file = illumos-utils/src/zone.rs:325
11152024-11-07T02:42:40.962ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51 file = illumos-utils/src/zone.rs:325
11162024-11-07T02:42:40.967ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582 file = illumos-utils/src/zone.rs:325
11172024-11-07T02:42:40.973ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c file = illumos-utils/src/zone.rs:363
11182024-11-07T02:42:40.980ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481 file = illumos-utils/src/zone.rs:363
11192024-11-07T02:42:40.987ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51 file = illumos-utils/src/zone.rs:363
11202024-11-07T02:42:40.994ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f file = illumos-utils/src/zone.rs:363
11212024-11-07T02:42:41.001ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8 file = illumos-utils/src/zone.rs:363
11222024-11-07T02:42:41.008ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51 file = illumos-utils/src/zone.rs:363
11232024-11-07T02:42:41.015ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582 file = illumos-utils/src/zone.rs:363
11242024-11-07T02:42:41.079ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11252024-11-07T02:42:41.161ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11262024-11-07T02:42:41.233ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11272024-11-07T02:42:41.385ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11282024-11-07T02:42:41.390ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11292024-11-07T02:42:41.390ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11302024-11-07T02:42:41.487ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 255, 121]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11312024-11-07T02:42:41.487ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
11322024-11-07T02:42:41.530ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11332024-11-07T02:42:41.530ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11342024-11-07T02:42:41.585ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 169, 205]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11352024-11-07T02:42:41.586ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
11362024-11-07T02:42:41.587ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11372024-11-07T02:42:41.587ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11382024-11-07T02:42:41.679ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 250, 170]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11392024-11-07T02:42:41.679ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
11402024-11-07T02:42:41.682ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11412024-11-07T02:42:41.682ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11422024-11-07T02:42:41.738ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 129, 91]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11432024-11-07T02:42:41.739ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
11442024-11-07T02:42:41.793ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11452024-11-07T02:42:41.794ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11462024-11-07T02:42:41.794ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11472024-11-07T02:42:41.847ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 142, 227]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11482024-11-07T02:42:41.847ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
11492024-11-07T02:42:41.848ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11502024-11-07T02:42:41.848ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11512024-11-07T02:42:41.848ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11522024-11-07T02:42:41.848ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11532024-11-07T02:42:41.848ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11542024-11-07T02:42:41.848ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11552024-11-07T02:42:41.848ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11562024-11-07T02:42:41.848ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11572024-11-07T02:42:41.848ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11582024-11-07T02:42:41.848ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11592024-11-07T02:42:41.848ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11602024-11-07T02:42:41.850ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11612024-11-07T02:42:41.852ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11622024-11-07T02:42:41.852ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11632024-11-07T02:42:41.852ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11642024-11-07T02:42:41.854ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11652024-11-07T02:42:41.856ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11662024-11-07T02:42:41.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11672024-11-07T02:42:41.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11682024-11-07T02:42:41.949ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11692024-11-07T02:42:42.058ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9 file = illumos-utils/src/zone.rs:325
11702024-11-07T02:42:42.065ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b file = illumos-utils/src/zone.rs:325
11712024-11-07T02:42:42.072ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8 file = illumos-utils/src/zone.rs:325
11722024-11-07T02:42:42.080ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798 file = illumos-utils/src/zone.rs:325
11732024-11-07T02:42:42.088ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03 file = illumos-utils/src/zone.rs:325
11742024-11-07T02:42:42.101ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b file = illumos-utils/src/zone.rs:363
11752024-11-07T02:42:42.110ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8 file = illumos-utils/src/zone.rs:363
11762024-11-07T02:42:42.118ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9 file = illumos-utils/src/zone.rs:363
11772024-11-07T02:42:42.126ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798 file = illumos-utils/src/zone.rs:363
11782024-11-07T02:42:42.134ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03 file = illumos-utils/src/zone.rs:363
11792024-11-07T02:42:43.472ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11802024-11-07T02:42:43.472ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
11812024-11-07T02:42:43.524ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9ad521f2-498d-459f-9590-bf571f0f7fe6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5fbdfe5c-630a-4caa-ac0e-e7acc0fbcdd6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11822024-11-07T02:42:43.524ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
11832024-11-07T02:42:43.589ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_01d7d0b3-ada7-4e85-a6b4-686ef3c7940e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2b5404e5-ed60-4d91-884b-58e3998d7a40'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11842024-11-07T02:42:43.589ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
11852024-11-07T02:42:43.616ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1e683710-2494-4ab1-a637-7b528e143c16/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='aa60474a-57fa-487e-a91c-e882244b2430'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11862024-11-07T02:42:43.616ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
11872024-11-07T02:42:43.624ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11882024-11-07T02:42:43.624ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
11892024-11-07T02:42:43.634ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_93fe9b26-7c2f-4e28-82f2-0a5320409e66/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='937008ad-a2e9-4797-92bc-efab8a3324b6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902024-11-07T02:42:43.634ZINFOSledAgent (ServiceManager): Booting oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
11912024-11-07T02:42:43.733ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7779de2f-377d-433e-9f3f-656a23324b51/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4a2c78d6-a9ae-42fc-b1e9-a592a489be64'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11922024-11-07T02:42:43.733ZINFOSledAgent (ServiceManager): Booting oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
11932024-11-07T02:42:43.740ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_dddcfc0e-109d-4074-b924-e7a90aa78ab4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='84d730cb-d68e-4e85-90e6-71f82404710c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11942024-11-07T02:42:43.740ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e6e52c0a-a969-4298-91e8-02888028eb67/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ede1748e-d775-48e4-a3f7-d5cf01ccb74d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11952024-11-07T02:42:43.740ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
11962024-11-07T02:42:43.747ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
11972024-11-07T02:42:43.813ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11982024-11-07T02:42:43.813ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
11992024-11-07T02:42:43.847ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_655eee30-398b-4d0f-848d-1f66d242e6b9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='51fc5486-542f-4190-a273-015f3cf48897'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12002024-11-07T02:42:43.847ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
12012024-11-07T02:42:44.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 31.368453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
12022024-11-07T02:42:44.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 47.756416ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
12032024-11-07T02:42:44.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 55.96282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
12042024-11-07T02:42:44.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 30.466389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
12052024-11-07T02:42:44.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 35.59215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
12062024-11-07T02:42:44.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 39.225339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
12072024-11-07T02:42:44.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 47.56946ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
12082024-11-07T02:42:44.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 36.2382ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
12092024-11-07T02:42:44.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 109.764876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
12102024-11-07T02:42:44.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 35.778157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
12112024-11-07T02:42:44.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 64.625308ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
12122024-11-07T02:42:44.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 40.099167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
12132024-11-07T02:42:44.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 92.381777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
12142024-11-07T02:42:44.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 116.727035ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
12152024-11-07T02:42:44.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 54.642892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
12162024-11-07T02:42:44.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 93.274653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
12172024-11-07T02:42:44.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 73.177227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
12182024-11-07T02:42:44.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 125.801792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
12192024-11-07T02:42:45.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 113.375912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
12202024-11-07T02:42:45.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 198.711123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
12212024-11-07T02:42:45.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 139.605397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
12222024-11-07T02:42:45.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 89.977894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
12232024-11-07T02:42:45.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 107.579791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
12242024-11-07T02:42:45.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 246.239532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
12252024-11-07T02:42:45.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 129.226903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
12262024-11-07T02:42:45.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 121.32634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
12272024-11-07T02:42:45.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 192.537113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
12282024-11-07T02:42:45.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 124.298675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
12292024-11-07T02:42:45.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 214.146174ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
12302024-11-07T02:42:45.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 219.412795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
12312024-11-07T02:42:45.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 203.562693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
12322024-11-07T02:42:45.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 297.229474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
12332024-11-07T02:42:45.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 174.031045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
12342024-11-07T02:42:45.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 400.939279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
12352024-11-07T02:42:45.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 290.908833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
12362024-11-07T02:42:45.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 567.859028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
12372024-11-07T02:42:45.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 200.617387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
12382024-11-07T02:42:45.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 539.243472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
12392024-11-07T02:42:45.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 274.125121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
12402024-11-07T02:42:45.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 259.397385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
12412024-11-07T02:42:45.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 302.098071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
12422024-11-07T02:42:45.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 323.993036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
12432024-11-07T02:42:45.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 416.818534ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
12442024-11-07T02:42:45.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.089047599s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
12452024-11-07T02:42:45.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 583.746283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
12462024-11-07T02:42:45.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 670.143499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
12472024-11-07T02:42:45.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 573.590646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
12482024-11-07T02:42:45.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 490.271103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
12492024-11-07T02:42:45.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.139578476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
12502024-11-07T02:42:45.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 671.463478ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
12512024-11-07T02:42:45.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 477.700782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
12522024-11-07T02:42:45.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.166501541s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
12532024-11-07T02:42:45.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.073132035s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
12542024-11-07T02:42:45.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 886.837409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
12552024-11-07T02:42:46.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 525.706416ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
12562024-11-07T02:42:46.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.353990213s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
12572024-11-07T02:42:46.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 928.16315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
12582024-11-07T02:42:46.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 932.498303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
12592024-11-07T02:42:46.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.174895073s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
12602024-11-07T02:42:46.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.156790849s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
12612024-11-07T02:42:46.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 748.348357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
12622024-11-07T02:42:46.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.295511916s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
12632024-11-07T02:42:46.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 612.093613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
12642024-11-07T02:42:46.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.095375228s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
12652024-11-07T02:42:46.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 758.826421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
12662024-11-07T02:42:47.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.167467516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
12672024-11-07T02:42:47.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.107182676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
12682024-11-07T02:42:47.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 551.654043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
12692024-11-07T02:42:47.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.055318717s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
12702024-11-07T02:42:47.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.448389092s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
12712024-11-07T02:42:47.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 842.41314ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
12722024-11-07T02:42:47.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 944.020106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
12732024-11-07T02:42:47.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 705.804262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
12742024-11-07T02:42:47.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.322058286s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
12752024-11-07T02:42:47.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.093811231s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
12762024-11-07T02:42:47.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 567.238102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
12772024-11-07T02:42:48.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 678.546007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
12782024-11-07T02:42:48.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.442238798s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
12792024-11-07T02:42:48.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 809.245063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
12802024-11-07T02:42:48.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 799.312281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
12812024-11-07T02:42:48.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 737.113342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
12822024-11-07T02:42:48.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.387015468s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
12832024-11-07T02:42:48.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 643.632271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
12842024-11-07T02:42:48.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.253214299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
12852024-11-07T02:42:48.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.411681076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
12862024-11-07T02:42:48.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 732.73919ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
12872024-11-07T02:42:48.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 745.475394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
12882024-11-07T02:42:49.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.373109182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
12892024-11-07T02:42:49.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 989.437411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
12902024-11-07T02:42:49.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.376344259s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
12912024-11-07T02:42:49.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.442670905s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
12922024-11-07T02:42:49.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.134415207s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
12932024-11-07T02:42:49.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.09648799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
12942024-11-07T02:42:49.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 930.076413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
12952024-11-07T02:42:49.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 875.227938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
12962024-11-07T02:42:49.781ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_54f9243c-18e6-42c9-935c-0dc4151c5bea/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b1d909d8-83e8-475e-97ae-ca79524912e4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12972024-11-07T02:42:49.781ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
12982024-11-07T02:42:49.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.206944304s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
12992024-11-07T02:42:49.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 859.922701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
13002024-11-07T02:42:49.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 58.898652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
13012024-11-07T02:42:50.035ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='b018a048-2a68-4115-9eeb-3b78701e4f51'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13022024-11-07T02:42:50.036ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
13032024-11-07T02:42:50.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 63.139076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
13042024-11-07T02:42:50.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 507.248966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
13052024-11-07T02:42:50.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 193.639886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
13062024-11-07T02:42:50.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.009150313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
13072024-11-07T02:42:50.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 47.696898ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
13082024-11-07T02:42:50.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 126.582461ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
13092024-11-07T02:42:50.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 379.165981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
13102024-11-07T02:42:50.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 880.724348ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
13112024-11-07T02:42:50.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 296.059957ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
13122024-11-07T02:42:50.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 719.255013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
13132024-11-07T02:42:50.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 659.06486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
13142024-11-07T02:42:50.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.231598539s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
13152024-11-07T02:42:50.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.346835809s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
13162024-11-07T02:42:50.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.327820499s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
13172024-11-07T02:42:50.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 878.984883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
13182024-11-07T02:42:50.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.083160239s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
13192024-11-07T02:42:50.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.073015801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
13202024-11-07T02:42:50.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 700.426762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
13212024-11-07T02:42:50.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 505.627868ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
13222024-11-07T02:42:51.013ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13232024-11-07T02:42:51.013ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
13242024-11-07T02:42:51.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 882.258745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
13252024-11-07T02:42:51.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.34800681s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
13262024-11-07T02:42:51.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 59.042041ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
13272024-11-07T02:42:51.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 793.404301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
13282024-11-07T02:42:51.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 779.944684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
13292024-11-07T02:42:51.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 836.442331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
13302024-11-07T02:42:51.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 134.0738ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
13312024-11-07T02:42:51.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 878.198061ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
13322024-11-07T02:42:51.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 147.595165ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
13332024-11-07T02:42:51.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.400027354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
13342024-11-07T02:42:51.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.443036033s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
13352024-11-07T02:42:51.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 290.397005ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
13362024-11-07T02:42:51.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 758.462006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
13372024-11-07T02:42:51.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 599.82297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
13382024-11-07T02:42:51.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.354379031s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
13392024-11-07T02:42:51.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 623.593508ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
13402024-11-07T02:42:51.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 579.316486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
13412024-11-07T02:42:51.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.460698078s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
13422024-11-07T02:42:51.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.437922871s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
13432024-11-07T02:42:52.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.047762894s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
13442024-11-07T02:42:52.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 791.535702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
13452024-11-07T02:42:52.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.460895132s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
13462024-11-07T02:42:52.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 804.360701ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
13472024-11-07T02:42:52.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.253137982s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
13482024-11-07T02:42:52.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.085820453s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
13492024-11-07T02:42:52.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.291580664s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
13502024-11-07T02:42:52.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.366704134s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
13512024-11-07T02:42:52.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 553.843571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
13522024-11-07T02:42:52.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.347927321s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
13532024-11-07T02:42:52.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.040943027s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
13542024-11-07T02:42:52.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 538.933108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
13552024-11-07T02:42:52.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 703.283182ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
13562024-11-07T02:42:53.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 663.931016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
13572024-11-07T02:42:53.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 770.581677ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
13582024-11-07T02:42:53.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 783.141905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
13592024-11-07T02:42:53.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.352852619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
13602024-11-07T02:42:53.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 995.840905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
13612024-11-07T02:42:53.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.389813063s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
13622024-11-07T02:42:53.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 806.116533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
13632024-11-07T02:42:53.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.162332983s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
13642024-11-07T02:42:53.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 755.568119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
13652024-11-07T02:42:53.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 773.745887ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
13662024-11-07T02:42:53.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.10418677s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
13672024-11-07T02:42:53.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 816.223409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
13682024-11-07T02:42:54.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.422805691s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
13692024-11-07T02:42:54.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.420640357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
13702024-11-07T02:42:54.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.244676814s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
13712024-11-07T02:42:54.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.082670254s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
13722024-11-07T02:42:54.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 797.60144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
13732024-11-07T02:42:54.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.026416445s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
13742024-11-07T02:42:54.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 566.366873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
13752024-11-07T02:42:54.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 615.246725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
13762024-11-07T02:42:54.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 811.577164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
13772024-11-07T02:42:54.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.218192227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
13782024-11-07T02:42:54.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 786.399445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
13792024-11-07T02:42:54.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.126595054s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
13802024-11-07T02:42:54.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 638.03823ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
13812024-11-07T02:42:54.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.352030645s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
13822024-11-07T02:42:54.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 826.068532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
13832024-11-07T02:42:55.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.465422124s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
13842024-11-07T02:42:55.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.037554362s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
13852024-11-07T02:42:55.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 657.418435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
13862024-11-07T02:42:55.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.296676967s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
13872024-11-07T02:42:55.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 990.791781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
13882024-11-07T02:42:55.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.386677669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
13892024-11-07T02:42:55.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 606.491523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
13902024-11-07T02:42:55.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 682.671549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
13912024-11-07T02:42:55.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.212816659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
13922024-11-07T02:42:55.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.208118078s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
13932024-11-07T02:42:55.628ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13942024-11-07T02:42:55.628ZINFOSledAgent (ServiceManager): Booting oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
13952024-11-07T02:42:55.682ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13962024-11-07T02:42:55.682ZINFOSledAgent (ServiceManager): Booting oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
13972024-11-07T02:42:55.706ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13982024-11-07T02:42:55.706ZINFOSledAgent (ServiceManager): Booting oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
13992024-11-07T02:42:55.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 45.555623ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
14002024-11-07T02:42:55.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 890.115525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
14012024-11-07T02:42:55.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 60.978282ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
14022024-11-07T02:42:55.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 114.300605ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
14032024-11-07T02:42:55.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.068468056s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
14042024-11-07T02:42:55.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 53.93032ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
14052024-11-07T02:42:55.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 79.06488ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
14062024-11-07T02:42:55.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 64.880459ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
14072024-11-07T02:42:55.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 642.682946ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
14082024-11-07T02:42:55.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 263.897021ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
14092024-11-07T02:42:55.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 185.081844ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
14102024-11-07T02:42:56.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 122.69608ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
14112024-11-07T02:42:56.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 997.815469ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
14122024-11-07T02:42:56.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 964.018652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
14132024-11-07T02:42:56.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 535.425626ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
14142024-11-07T02:42:56.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 562.083804ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
14152024-11-07T02:42:56.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 628.870142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
14162024-11-07T02:42:56.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.176363013s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
14172024-11-07T02:42:56.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.306111089s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
14182024-11-07T02:42:56.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.156164764s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
14192024-11-07T02:42:56.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.370462597s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
14202024-11-07T02:42:56.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 441.463814ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
14212024-11-07T02:42:56.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 873.763703ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
14222024-11-07T02:42:56.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 513.697346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
14232024-11-07T02:42:56.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 672.478444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
14242024-11-07T02:42:56.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 917.669853ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
14252024-11-07T02:42:56.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 918.726361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
14262024-11-07T02:42:56.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.410271939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
14272024-11-07T02:42:56.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.253449158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
14282024-11-07T02:42:56.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 576.373725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
14292024-11-07T02:42:57.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 851.578973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
14302024-11-07T02:42:57.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.130238553s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
14312024-11-07T02:42:57.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.007518756s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
14322024-11-07T02:42:57.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 658.619764ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
14332024-11-07T02:42:57.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.272203084s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
14342024-11-07T02:42:57.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 733.94713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
14352024-11-07T02:42:57.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 740.239877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
14362024-11-07T02:42:57.483ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14372024-11-07T02:42:57.483ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
14382024-11-07T02:42:57.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 720.285972ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
14392024-11-07T02:42:57.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.230289427s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
14402024-11-07T02:42:57.637ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14412024-11-07T02:42:57.637ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
14422024-11-07T02:42:57.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 875.399274ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
14432024-11-07T02:42:57.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 697.432962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
14442024-11-07T02:42:57.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.432659288s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
14452024-11-07T02:42:57.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 1.499848212s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
14462024-11-07T02:42:57.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.309891794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
14472024-11-07T02:42:57.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 30.139757ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
14482024-11-07T02:42:57.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 929.92609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
14492024-11-07T02:42:57.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 117.023863ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
14502024-11-07T02:42:57.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 640.683584ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
14512024-11-07T02:42:57.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 64.378564ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
14522024-11-07T02:42:57.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.364490871s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
14532024-11-07T02:42:58.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 105.732236ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
14542024-11-07T02:42:58.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 589.827881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
14552024-11-07T02:42:58.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 257.490478ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
14562024-11-07T02:42:58.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.184322232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
14572024-11-07T02:42:58.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.460677678s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
14582024-11-07T02:42:58.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 259.480253ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
14592024-11-07T02:42:58.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 873.928939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
14602024-11-07T02:42:58.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.2908473s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
14612024-11-07T02:42:58.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.30845842s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
14622024-11-07T02:42:58.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 770.275444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
14632024-11-07T02:42:58.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 365.380315ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
14642024-11-07T02:42:58.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 295.368731ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
14652024-11-07T02:42:58.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.328888467s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
14662024-11-07T02:42:58.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 869.950541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
14672024-11-07T02:42:58.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 812.595544ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
14682024-11-07T02:42:58.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.111100174s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
14692024-11-07T02:42:58.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.431135923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
14702024-11-07T02:42:58.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 1.175571509s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
14712024-11-07T02:42:58.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 506.816285ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
14722024-11-07T02:42:58.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 801.336934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
14732024-11-07T02:42:58.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 714.046609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
14742024-11-07T02:42:59.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.452116771s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
14752024-11-07T02:42:59.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 700.212299ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
14762024-11-07T02:42:59.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 525.321688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
14772024-11-07T02:42:59.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 665.544023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
14782024-11-07T02:42:59.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 971.394439ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
14792024-11-07T02:42:59.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 537.55986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
14802024-11-07T02:42:59.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 1.052457033s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
14812024-11-07T02:42:59.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.319709015s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
14822024-11-07T02:42:59.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 646.703003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
14832024-11-07T02:42:59.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 1.270455539s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
14842024-11-07T02:42:59.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 839.465387ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
14852024-11-07T02:42:59.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.390606117s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
14862024-11-07T02:42:59.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.166476316s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
14872024-11-07T02:42:59.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 920.413014ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
14882024-11-07T02:42:59.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.217619811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
14892024-11-07T02:42:59.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.037641041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
14902024-11-07T02:42:59.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.235389929s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
14912024-11-07T02:42:59.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 753.591599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
14922024-11-07T02:42:59.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.400575885s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
14932024-11-07T02:42:59.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 503.150009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
14942024-11-07T02:42:59.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 767.389546ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
14952024-11-07T02:42:59.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.488501575s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
14962024-11-07T02:43:00.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.351925432s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
14972024-11-07T02:43:00.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 636.805532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
14982024-11-07T02:43:00.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 571.110698ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
14992024-11-07T02:43:00.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 657.169716ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
15002024-11-07T02:43:00.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.208068336s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
15012024-11-07T02:43:00.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 1.160747892s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
15022024-11-07T02:43:00.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 883.629162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
15032024-11-07T02:43:00.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.169176135s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
15042024-11-07T02:43:00.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.209618363s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
15052024-11-07T02:43:00.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 904.253945ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
15062024-11-07T02:43:00.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.110561035s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
15072024-11-07T02:43:00.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 966.084545ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
15082024-11-07T02:43:00.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 791.800992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
15092024-11-07T02:43:00.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 562.073126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
15102024-11-07T02:43:00.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.371617476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
15112024-11-07T02:43:00.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 956.36441ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
15122024-11-07T02:43:00.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 943.732699ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
15132024-11-07T02:43:00.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 602.337343ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
15142024-11-07T02:43:00.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.368025168s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
15152024-11-07T02:43:01.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 563.530304ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
15162024-11-07T02:43:01.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.267949867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
15172024-11-07T02:43:01.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 679.817397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
15182024-11-07T02:43:01.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.093229205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
15192024-11-07T02:43:01.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 569.772867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
15202024-11-07T02:43:01.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 870.004329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
15212024-11-07T02:43:01.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 984.03541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
15222024-11-07T02:43:01.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 812.147716ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
15232024-11-07T02:43:01.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 858.151192ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
15242024-11-07T02:43:01.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.000115402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
15252024-11-07T02:43:01.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 1.074902124s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
15262024-11-07T02:43:01.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.035304404s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
15272024-11-07T02:43:01.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 736.186921ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
15282024-11-07T02:43:01.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.055229428s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
15292024-11-07T02:43:01.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.101625435s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
15302024-11-07T02:43:01.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 953.765667ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
15312024-11-07T02:43:01.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 540.293291ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
15322024-11-07T02:43:01.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.430699815s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
15332024-11-07T02:43:01.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 815.799456ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
15342024-11-07T02:43:01.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.166242049s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
15352024-11-07T02:43:02.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.090596362s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
15362024-11-07T02:43:02.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.38345651s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
15372024-11-07T02:43:02.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.127537048s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
15382024-11-07T02:43:02.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 967.251565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
15392024-11-07T02:43:02.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 1.255051396s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
15402024-11-07T02:43:02.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 1.078878619s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
15412024-11-07T02:43:02.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 604.560323ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
15422024-11-07T02:43:02.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.204431089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
15432024-11-07T02:43:02.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 978.193795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
15442024-11-07T02:43:02.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.295808377s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
15452024-11-07T02:43:02.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 861.948607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
15462024-11-07T02:43:02.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 657.136662ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
15472024-11-07T02:43:02.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 885.126879ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
15482024-11-07T02:43:02.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 626.367098ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
15492024-11-07T02:43:02.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.181823394s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
15502024-11-07T02:43:02.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 919.099675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
15512024-11-07T02:43:02.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 736.272488ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
15522024-11-07T02:43:03.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.228808165s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
15532024-11-07T02:43:03.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.443162697s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
15542024-11-07T02:43:03.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.21401188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
15552024-11-07T02:43:03.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.486274134s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
15562024-11-07T02:43:03.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 848.751249ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
15572024-11-07T02:43:03.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.246424293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
15582024-11-07T02:43:03.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 1.249446675s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
15592024-11-07T02:43:03.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 868.629735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
15602024-11-07T02:43:03.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.379415721s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
15612024-11-07T02:43:03.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 934.767719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
15622024-11-07T02:43:03.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 635.251716ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
15632024-11-07T02:43:03.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 1.114217499s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
15642024-11-07T02:43:03.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 849.65059ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
15652024-11-07T02:43:03.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 640.333208ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
15662024-11-07T02:43:03.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 926.219725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
15672024-11-07T02:43:03.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 883.168929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
15682024-11-07T02:43:03.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.01826998s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
15692024-11-07T02:43:03.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.063900261s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
15702024-11-07T02:43:03.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 641.087524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
15712024-11-07T02:43:04.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 1.241622414s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
15722024-11-07T02:43:04.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.486814453s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
15732024-11-07T02:43:04.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 1.269850135s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
15742024-11-07T02:43:04.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.14949471s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
15752024-11-07T02:43:04.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.094175091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
15762024-11-07T02:43:04.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 649.256841ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
15772024-11-07T02:43:04.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 799.912529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
15782024-11-07T02:43:04.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.463983658s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
15792024-11-07T02:43:04.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.146815672s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
15802024-11-07T02:43:04.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.129506431s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
15812024-11-07T02:43:04.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.465128391s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
15822024-11-07T02:43:04.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.15729641s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
15832024-11-07T02:43:04.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 584.835819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
15842024-11-07T02:43:04.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 1.036189392s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
15852024-11-07T02:43:04.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 1.427870576s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
15862024-11-07T02:43:04.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 757.303094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
15872024-11-07T02:43:04.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.384070987s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
15882024-11-07T02:43:04.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 839.615301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
15892024-11-07T02:43:04.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 714.160477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
15902024-11-07T02:43:05.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.234654168s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
15912024-11-07T02:43:05.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.417131154s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
15922024-11-07T02:43:05.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 534.432364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
15932024-11-07T02:43:05.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 1.247022428s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
15942024-11-07T02:43:05.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 952.623962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
15952024-11-07T02:43:05.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 638.39762ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
15962024-11-07T02:43:05.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 798.211169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
15972024-11-07T02:43:05.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 841.398831ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
15982024-11-07T02:43:05.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.242038228s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
15992024-11-07T02:43:05.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 745.777513ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
16002024-11-07T02:43:05.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 760.547171ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
16012024-11-07T02:43:05.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.296498684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
16022024-11-07T02:43:05.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.461526157s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
16032024-11-07T02:43:05.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 768.266925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
16042024-11-07T02:43:05.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.122112525s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
16052024-11-07T02:43:05.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 622.475345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
16062024-11-07T02:43:05.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.38079098s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
16072024-11-07T02:43:06.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.278064728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
16082024-11-07T02:43:06.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 966.332405ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
16092024-11-07T02:43:06.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 1.41859792s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
16102024-11-07T02:43:06.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.116691535s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
16112024-11-07T02:43:06.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 597.055365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
16122024-11-07T02:43:06.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.020070194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
16132024-11-07T02:43:06.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.27754845s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
16142024-11-07T02:43:06.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 749.006927ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
16152024-11-07T02:43:06.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.306615215s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
16162024-11-07T02:43:06.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 625.829224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
16172024-11-07T02:43:06.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 1.070742591s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
16182024-11-07T02:43:06.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.474504499s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
16192024-11-07T02:43:06.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.432734312s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
16202024-11-07T02:43:06.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 682.345926ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
16212024-11-07T02:43:06.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.441473307s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
16222024-11-07T02:43:06.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 729.1002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
16232024-11-07T02:43:06.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.195549447s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
16242024-11-07T02:43:07.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 881.188297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
16252024-11-07T02:43:07.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 887.33232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
16262024-11-07T02:43:07.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 932.516412ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
16272024-11-07T02:43:07.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 873.772152ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
16282024-11-07T02:43:07.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 755.501229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
16292024-11-07T02:43:07.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 652.111206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
16302024-11-07T02:43:07.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.304917179s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
16312024-11-07T02:43:07.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 673.610992ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
16322024-11-07T02:43:07.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.290794012s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
16332024-11-07T02:43:07.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.42837761s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
16342024-11-07T02:43:07.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 1.106247981s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
16352024-11-07T02:43:07.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 950.131285ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
16362024-11-07T02:43:07.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.099781866s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
16372024-11-07T02:43:07.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 819.205431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
16382024-11-07T02:43:07.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 587.968554ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
16392024-11-07T02:43:07.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.059184696s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
16402024-11-07T02:43:07.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.451529053s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
16412024-11-07T02:43:07.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.353758893s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
16422024-11-07T02:43:07.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.112473261s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
16432024-11-07T02:43:08.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 638.592332ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
16442024-11-07T02:43:08.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.255446795s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
16452024-11-07T02:43:08.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 553.138565ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
16462024-11-07T02:43:08.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 882.819094ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
16472024-11-07T02:43:08.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 993.343394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
16482024-11-07T02:43:08.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 971.623714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
16492024-11-07T02:43:08.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.092139492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
16502024-11-07T02:43:08.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.342538646s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
16512024-11-07T02:43:08.343ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 65.078523803s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
16522024-11-07T02:43:08.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 660.943468ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
16532024-11-07T02:43:08.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 657.183842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
16542024-11-07T02:43:08.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 748.975118ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
16552024-11-07T02:43:08.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.346386168s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
16562024-11-07T02:43:08.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.324757961s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
16572024-11-07T02:43:08.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 575.159068ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
16582024-11-07T02:43:08.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 677.414203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
16592024-11-07T02:43:08.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.21712662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
16602024-11-07T02:43:08.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.099989589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
16612024-11-07T02:43:08.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 572.55944ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
16622024-11-07T02:43:08.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 885.82946ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
16632024-11-07T02:43:09.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.329122437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
16642024-11-07T02:43:09.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 891.693345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
16652024-11-07T02:43:09.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 613.13536ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
16662024-11-07T02:43:09.143ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64729
16672024-11-07T02:43:09.143ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64729 req_id = a4719607-e457-4ded-a579-ceada7e6aea8 response_code = 200 uri = /baseboard
16682024-11-07T02:43:09.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 837.121191ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
16692024-11-07T02:43:09.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.144870261s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
16702024-11-07T02:43:09.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 1.198971312s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
16712024-11-07T02:43:09.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 781.10867ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
16722024-11-07T02:43:09.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 562.437491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
16732024-11-07T02:43:09.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 536.461763ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
16742024-11-07T02:43:09.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 610.916426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
16752024-11-07T02:43:09.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.462083222s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
16762024-11-07T02:43:09.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.017633409s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
16772024-11-07T02:43:09.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 1.354038674s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
16782024-11-07T02:43:09.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.405904186s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
16792024-11-07T02:43:09.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.294881156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
16802024-11-07T02:43:09.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.384971661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
16812024-11-07T02:43:09.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 1.05565796s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
16822024-11-07T02:43:09.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.301426777s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
16832024-11-07T02:43:09.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.346758599s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
16842024-11-07T02:43:09.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 657.60284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
16852024-11-07T02:43:10.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 589.894003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
16862024-11-07T02:43:10.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 977.99868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
16872024-11-07T02:43:10.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 728.167856ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
16882024-11-07T02:43:10.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 970.802738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
16892024-11-07T02:43:10.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 985.646804ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
16902024-11-07T02:43:10.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 678.010131ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
16912024-11-07T02:43:10.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.070451653s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
16922024-11-07T02:43:10.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.044625487s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
16932024-11-07T02:43:10.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.036713364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
16942024-11-07T02:43:10.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 884.923369ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
16952024-11-07T02:43:10.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.441089548s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
16962024-11-07T02:43:10.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.186584999s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
16972024-11-07T02:43:10.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 991.550802ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
16982024-11-07T02:43:10.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.085446374s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
16992024-11-07T02:43:10.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.212258263s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
17002024-11-07T02:43:10.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 522.957761ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
17012024-11-07T02:43:10.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 1.367016063s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
17022024-11-07T02:43:11.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.282745387s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
17032024-11-07T02:43:11.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 812.093113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
17042024-11-07T02:43:11.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.192158052s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
17052024-11-07T02:43:11.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 550.750304ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
17062024-11-07T02:43:11.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.090750395s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
17072024-11-07T02:43:11.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 775.629529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
17082024-11-07T02:43:11.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 628.245854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
17092024-11-07T02:43:11.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.420872408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
17102024-11-07T02:43:11.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 1.194766193s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
17112024-11-07T02:43:11.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 545.841899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
17122024-11-07T02:43:11.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 1.034637334s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
17132024-11-07T02:43:11.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.073703492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
17142024-11-07T02:43:11.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 813.818122ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
17152024-11-07T02:43:11.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 740.73574ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
17162024-11-07T02:43:11.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.495658804s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
17172024-11-07T02:43:11.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.061770351s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
17182024-11-07T02:43:11.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.489781882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
17192024-11-07T02:43:11.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.478394994s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
17202024-11-07T02:43:11.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 862.287051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
17212024-11-07T02:43:12.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.134029672s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
17222024-11-07T02:43:12.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 735.872751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
17232024-11-07T02:43:12.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 509.46224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
17242024-11-07T02:43:12.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 947.434983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
17252024-11-07T02:43:12.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.059961245s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
17262024-11-07T02:43:12.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.440843822s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
17272024-11-07T02:43:12.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.05569715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
17282024-11-07T02:43:12.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.141782584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
17292024-11-07T02:43:12.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 1.222361112s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
17302024-11-07T02:43:12.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 717.515258ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
17312024-11-07T02:43:12.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 1.161318173s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
17322024-11-07T02:43:12.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 1.218044009s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
17332024-11-07T02:43:12.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 574.712068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
17342024-11-07T02:43:12.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 772.037933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
17352024-11-07T02:43:12.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 991.723023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
17362024-11-07T02:43:12.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 644.805119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
17372024-11-07T02:43:12.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.188006846s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
17382024-11-07T02:43:12.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 528.045686ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
17392024-11-07T02:43:13.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.110681926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
17402024-11-07T02:43:13.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 1.099900479s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
17412024-11-07T02:43:13.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.405364847s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
17422024-11-07T02:43:13.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 582.748177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
17432024-11-07T02:43:13.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 654.060029ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
17442024-11-07T02:43:13.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.129653003s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
17452024-11-07T02:43:13.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.394791844s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
17462024-11-07T02:43:13.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.047932467s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
17472024-11-07T02:43:13.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 906.50567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
17482024-11-07T02:43:13.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 522.392982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
17492024-11-07T02:43:13.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.079506186s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
17502024-11-07T02:43:13.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.13277002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
17512024-11-07T02:43:13.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 953.153411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
17522024-11-07T02:43:13.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 1.042552969s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
17532024-11-07T02:43:13.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 1.2939991s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
17542024-11-07T02:43:13.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 1.221223505s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
17552024-11-07T02:43:13.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 696.479653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
17562024-11-07T02:43:13.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 954.200964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
17572024-11-07T02:43:13.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 827.450963ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
17582024-11-07T02:43:13.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 507.690563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
17592024-11-07T02:43:13.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.077694587s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
17602024-11-07T02:43:14.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.439237638s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
17612024-11-07T02:43:14.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891") failed: Property not found. retry in 1.253070713s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
17622024-11-07T02:43:14.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 528.596697ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
17632024-11-07T02:43:14.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.476517786s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
17642024-11-07T02:43:14.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 1.322209572s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
17652024-11-07T02:43:14.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 732.819599ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
17662024-11-07T02:43:14.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.207487817s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
17672024-11-07T02:43:14.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 814.036834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
17682024-11-07T02:43:14.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582") failed: Property not found. retry in 1.468407635s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
17692024-11-07T02:43:14.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 938.342099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
17702024-11-07T02:43:14.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.268304257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
17712024-11-07T02:43:14.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 573.421853ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
17722024-11-07T02:43:14.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 1.408279028s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
17732024-11-07T02:43:14.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 877.530944ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
17742024-11-07T02:43:14.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 807.208423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
17752024-11-07T02:43:14.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 632.660998ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
17762024-11-07T02:43:14.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 1.223637292s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
17772024-11-07T02:43:14.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 673.373827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
17782024-11-07T02:43:15.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 995.362401ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
17792024-11-07T02:43:15.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.383435433s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
17802024-11-07T02:43:15.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 815.856558ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
17812024-11-07T02:43:15.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 538.097233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
17822024-11-07T02:43:15.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.111816613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
17832024-11-07T02:43:15.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed") failed: Property not found. retry in 1.496168305s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
17842024-11-07T02:43:15.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 654.00798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
17852024-11-07T02:43:15.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 657.747519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
17862024-11-07T02:43:15.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798") failed: Property not found. retry in 1.274603216s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
17872024-11-07T02:43:15.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c") failed: Property not found. retry in 1.075557971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
17882024-11-07T02:43:15.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 725.922768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
17892024-11-07T02:43:15.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481") failed: Property not found. retry in 1.032764615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
17902024-11-07T02:43:15.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8") failed: Property not found. retry in 1.45640247s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
17912024-11-07T02:43:15.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51") failed: Property not found. retry in 549.933237ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
17922024-11-07T02:43:15.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51") failed: Property not found. retry in 1.02986365s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
17932024-11-07T02:43:15.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677") failed: Property not found. retry in 1.144786949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
17942024-11-07T02:43:16.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b") failed: Property not found. retry in 681.66856ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
17952024-11-07T02:43:16.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03") failed: Property not found. retry in 1.3612856s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
17962024-11-07T02:43:16.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9") failed: Property not found. retry in 1.3659891s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
17972024-11-07T02:43:16.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a") failed: Property not found. retry in 581.152022ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
17982024-11-07T02:43:16.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0") failed: Property not found. retry in 1.246818176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
17992024-11-07T02:43:16.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f") failed: Property not found. retry in 1.143576969s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
18002024-11-07T02:43:16.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4") failed: Property not found. retry in 823.299159ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
18012024-11-07T02:43:16.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253") failed: Property not found. retry in 1.042345821s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
18022024-11-07T02:43:16.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8") failed: Property not found. retry in 1.416236275s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
18032024-11-07T02:43:17.153ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18042024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_585aaa98-c3b7-4a1f-979c-2088fe719dd8
18052024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_3c2cbf43-20e6-448e-9f34-069f41bf88a4
18062024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_d0c3cf40-824d-4318-b4c1-a2d226c53eb0
18072024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_0d502811-de24-4e27-b92c-fccb5bf9f798
18082024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_6645e1a6-5f27-4997-a3fa-4439c3e7f891
18092024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_8d44a8ba-e3ce-4ce4-bf93-31cc8e795fed
18102024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_b0c601a1-7d97-4f06-87d6-e780c076d253
18112024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_f2257614-9856-4344-bdd9-897edf2a5e03
18122024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_81e03cb2-6bdf-4324-a5c8-541c23e034b9
18132024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_222da6cf-e73a-4afd-a13f-39acf5585677
18142024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_clickhouse_2ace40de-e863-410c-83ad-f114661d380a
18152024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_43c763f8-8d01-40d7-9e52-7b33ee7e177c
18162024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_c66c4807-87bf-49f2-97cb-31d8d688e481
18172024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_ab506eeb-498b-4eb1-8da1-5259c9538f51
18182024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_cfce6b5d-973c-4736-93fb-e3347600566b
18192024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_0786ea6b-a214-47e7-9492-8bd8c5985f0f
18202024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_cf4c1888-20dd-44c7-845e-3841aa76d3b8
18212024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_oximeter_b018a048-2a68-4115-9eeb-3b78701e4f51
18222024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_5d010780-78d0-42d7-ad02-0127a9078582
18232024-11-07T02:43:17.919ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18242024-11-07T02:43:17.925ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18252024-11-07T02:43:17.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38794643 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52269 req_id = d5ae1bfa-bd42-418c-a30b-03b762d8fc91 response_code = 204 uri = /omicron-zones
18262024-11-07T02:43:17.935ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1331
18272024-11-07T02:43:17.935ZINFOSledAgent (RSS): Writing ledger to /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18282024-11-07T02:43:17.935ZINFOSledAgent (RSS): Writing ledger to /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18292024-11-07T02:43:17.938ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:708
18302024-11-07T02:43:17.938ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:720
18312024-11-07T02:43:17.987ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:896
18322024-11-07T02:43:17.987ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18332024-11-07T02:43:18.099ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18342024-11-07T02:43:18.156ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18352024-11-07T02:43:18.266ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18362024-11-07T02:43:18.363ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18372024-11-07T02:43:18.490ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18382024-11-07T02:43:18.801ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18392024-11-07T02:43:19.107ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18402024-11-07T02:43:19.158ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18412024-11-07T02:43:19.484ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18422024-11-07T02:43:19.689ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/nexus.rs:527 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18432024-11-07T02:43:19.902ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18442024-11-07T02:43:20.159ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18452024-11-07T02:43:20.394ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18462024-11-07T02:43:21.059ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18472024-11-07T02:43:21.100ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/nexus.rs:527 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18482024-11-07T02:43:21.162ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18492024-11-07T02:43:21.765ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18502024-11-07T02:43:22.164ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18512024-11-07T02:43:22.346ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18522024-11-07T02:43:22.837ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18532024-11-07T02:43:23.100ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/nexus.rs:527 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18542024-11-07T02:43:23.166ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18552024-11-07T02:43:23.742ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18562024-11-07T02:43:24.168ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18572024-11-07T02:43:25.100ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/nexus.rs:527 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18582024-11-07T02:43:25.171ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18592024-11-07T02:43:25.325ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18602024-11-07T02:43:26.174ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18612024-11-07T02:43:27.099ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/nexus.rs:527 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18622024-11-07T02:43:27.176ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18632024-11-07T02:43:27.510ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
18642024-11-07T02:43:28.178ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed4702f9-ad41-4221-9a83-4f7d256be0d9) file = sled-agent/src/probe_manager.rs:231 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18652024-11-07T02:43:30.729ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d4b2ff54-0f2d-460a-aea8-4f16eb84aa61", "content-length": "173", "date": "Thu, 07 Nov 2024 02:43:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c\"", request_id: "d4b2ff54-0f2d-460a-aea8-4f16eb84aa61" } file = sled-agent/src/rack_setup/service.rs:958
18662024-11-07T02:43:31.260ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
18672024-11-07T02:43:32.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56703
18682024-11-07T02:43:32.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56703 req_id = 623948ba-fe70-4cad-9fdd-cbd9a1a342e8 response_code = 200 uri = /vpc-routes
18692024-11-07T02:43:32.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43192
18702024-11-07T02:43:32.316ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18712024-11-07T02:43:32.316ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18722024-11-07T02:43:32.316ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:177
18732024-11-07T02:43:32.316ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:177
18742024-11-07T02:43:32.345ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
18752024-11-07T02:43:32.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56703 req_id = afdb8c67-07d0-4980-8349-1c03d9578a27 response_code = 204 uri = /eip-gateways
18762024-11-07T02:43:32.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44185
18772024-11-07T02:43:32.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44185 req_id = 21690936-16d3-420f-b50f-d978550981e4 response_code = 200 uri = /v2p
18782024-11-07T02:43:32.548ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "efb171e3-b3c3-43ca-bce4-8f7e00a69331", "content-length": "173", "date": "Thu, 07 Nov 2024 02:43:32 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b690dfaf-8637-4b9e-bca2-53b4e2fd6d4c\"", request_id: "efb171e3-b3c3-43ca-bce4-8f7e00a69331" } file = sled-agent/src/rack_setup/service.rs:958
18792024-11-07T02:43:32.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 237257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43192 req_id = bff166c4-019f-44a5-a51e-2b4dd0ab8925 response_code = 200 uri = /inventory
18802024-11-07T02:43:32.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 904 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56703 req_id = 948f2653-6372-4370-b9ce-25cc98f69ecd response_code = 204 uri = /vpc-routes
18812024-11-07T02:43:33.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45047
18822024-11-07T02:43:33.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45047 req_id = 4921b2c6-58fe-43af-abf9-b732907e1f22 response_code = 200 uri = /vpc-routes
18832024-11-07T02:43:33.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
18842024-11-07T02:43:33.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45047 req_id = 51018938-27c5-4e6c-b012-2d2153b05ffe response_code = 204 uri = /eip-gateways
18852024-11-07T02:43:33.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44300
18862024-11-07T02:43:33.353ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18872024-11-07T02:43:33.353ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18882024-11-07T02:43:33.353ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:177
18892024-11-07T02:43:33.354ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:177
18902024-11-07T02:43:33.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58394
18912024-11-07T02:43:33.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58394 req_id = 6b2385a5-189b-4c9a-a1b0-b0f9fa48f792 response_code = 200 uri = /vpc-routes
18922024-11-07T02:43:33.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37137
18932024-11-07T02:43:33.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18942024-11-07T02:43:33.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18952024-11-07T02:43:33.421ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:177
18962024-11-07T02:43:33.421ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:177
18972024-11-07T02:43:33.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46459
18982024-11-07T02:43:33.427ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18992024-11-07T02:43:33.427ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
19002024-11-07T02:43:33.427ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:177
19012024-11-07T02:43:33.427ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:177
19022024-11-07T02:43:33.525ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
19032024-11-07T02:43:33.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 695 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58394 req_id = ed964155-4df4-4247-8bc7-621a72b2d83f response_code = 204 uri = /eip-gateways
19042024-11-07T02:43:33.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1898 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45047 req_id = 2c835bc0-0191-4072-940f-2d5be33f3f6f response_code = 204 uri = /vpc-routes
19052024-11-07T02:43:33.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48729
19062024-11-07T02:43:33.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8916 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48729 req_id = adb4758f-f0da-49c2-ae7e-c39613ce9a1f response_code = 200 uri = /v2p
19072024-11-07T02:43:33.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59635
19082024-11-07T02:43:33.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59635 req_id = ac16b949-d619-4210-82f0-04818052e601 response_code = 200 uri = /v2p
19092024-11-07T02:43:33.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 294744 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44300 req_id = ef9de363-4b03-49f8-9cf6-84e26b1bfbb6 response_code = 200 uri = /inventory
19102024-11-07T02:43:33.668ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
19112024-11-07T02:43:33.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4524 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58394 req_id = 4130d624-6b7a-4bf0-8667-416d43830786 response_code = 204 uri = /vpc-routes
19122024-11-07T02:43:33.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 284021 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37137 req_id = 10d4e978-0cfd-4268-acdd-a07a584caef7 response_code = 200 uri = /inventory
19132024-11-07T02:43:33.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 284161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46459 req_id = 171c54b4-c941-4c95-9ce5-aeeca0e94628 response_code = 200 uri = /inventory
19142024-11-07T02:43:37.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58904
19152024-11-07T02:43:37.157ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e6dcf98-e56c-4c04-9515-6f635bc8207c, kind: Service { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 }, name: Name("external-dns-81e03cb2-6bdf-4324-a5c8-541c23e034b9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b0270c81-c1ae-4f80-b64a-fc343b0f5d05, kind: Service { id: f2257614-9856-4344-bdd9-897edf2a5e03 }, name: Name("external-dns-f2257614-9856-4344-bdd9-897edf2a5e03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5babe071-e49d-4d68-8a86-a6faf41174c4, kind: Service { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 }, name: Name("nexus-585aaa98-c3b7-4a1f-979c-2088fe719dd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 639dd02e-77b1-44c5-bb10-e9604a99b455, kind: Service { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 }, name: Name("nexus-0d502811-de24-4e27-b92c-fccb5bf9f798"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5ae62a3-3cee-4a00-a285-de4030662fb7, kind: Service { id: cfce6b5d-973c-4736-93fb-e3347600566b }, name: Name("nexus-cfce6b5d-973c-4736-93fb-e3347600566b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19162024-11-07T02:43:37.157ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19172024-11-07T02:43:37.157ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19182024-11-07T02:43:37.157ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19192024-11-07T02:43:37.157ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19202024-11-07T02:43:37.157ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19212024-11-07T02:43:37.157ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19222024-11-07T02:43:37.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58904 req_id = 901a22b4-5bbc-4537-859d-43411179f9e9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19232024-11-07T02:43:37.158ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:968
19242024-11-07T02:43:37.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55678
19252024-11-07T02:43:37.411ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e6dcf98-e56c-4c04-9515-6f635bc8207c, kind: Service { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 }, name: Name("external-dns-81e03cb2-6bdf-4324-a5c8-541c23e034b9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b0270c81-c1ae-4f80-b64a-fc343b0f5d05, kind: Service { id: f2257614-9856-4344-bdd9-897edf2a5e03 }, name: Name("external-dns-f2257614-9856-4344-bdd9-897edf2a5e03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5babe071-e49d-4d68-8a86-a6faf41174c4, kind: Service { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 }, name: Name("nexus-585aaa98-c3b7-4a1f-979c-2088fe719dd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 639dd02e-77b1-44c5-bb10-e9604a99b455, kind: Service { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 }, name: Name("nexus-0d502811-de24-4e27-b92c-fccb5bf9f798"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5ae62a3-3cee-4a00-a285-de4030662fb7, kind: Service { id: cfce6b5d-973c-4736-93fb-e3347600566b }, name: Name("nexus-cfce6b5d-973c-4736-93fb-e3347600566b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19262024-11-07T02:43:37.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19272024-11-07T02:43:37.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19282024-11-07T02:43:37.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19292024-11-07T02:43:37.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19302024-11-07T02:43:37.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19312024-11-07T02:43:37.411ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19322024-11-07T02:43:37.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55678 req_id = a92d7113-a2a4-41f5-bf67-fda01c751fad response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19332024-11-07T02:43:37.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41914
19342024-11-07T02:43:37.467ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e6dcf98-e56c-4c04-9515-6f635bc8207c, kind: Service { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 }, name: Name("external-dns-81e03cb2-6bdf-4324-a5c8-541c23e034b9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b0270c81-c1ae-4f80-b64a-fc343b0f5d05, kind: Service { id: f2257614-9856-4344-bdd9-897edf2a5e03 }, name: Name("external-dns-f2257614-9856-4344-bdd9-897edf2a5e03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5babe071-e49d-4d68-8a86-a6faf41174c4, kind: Service { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 }, name: Name("nexus-585aaa98-c3b7-4a1f-979c-2088fe719dd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 639dd02e-77b1-44c5-bb10-e9604a99b455, kind: Service { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 }, name: Name("nexus-0d502811-de24-4e27-b92c-fccb5bf9f798"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5ae62a3-3cee-4a00-a285-de4030662fb7, kind: Service { id: cfce6b5d-973c-4736-93fb-e3347600566b }, name: Name("nexus-cfce6b5d-973c-4736-93fb-e3347600566b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19352024-11-07T02:43:37.468ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19362024-11-07T02:43:37.468ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19372024-11-07T02:43:37.468ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19382024-11-07T02:43:37.468ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19392024-11-07T02:43:37.468ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19402024-11-07T02:43:37.468ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19412024-11-07T02:43:37.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41914 req_id = 337d5c06-a76c-40d0-acec-da80474f2944 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19422024-11-07T02:43:37.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64477
19432024-11-07T02:43:37.497ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e6dcf98-e56c-4c04-9515-6f635bc8207c, kind: Service { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 }, name: Name("external-dns-81e03cb2-6bdf-4324-a5c8-541c23e034b9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b0270c81-c1ae-4f80-b64a-fc343b0f5d05, kind: Service { id: f2257614-9856-4344-bdd9-897edf2a5e03 }, name: Name("external-dns-f2257614-9856-4344-bdd9-897edf2a5e03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5babe071-e49d-4d68-8a86-a6faf41174c4, kind: Service { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 }, name: Name("nexus-585aaa98-c3b7-4a1f-979c-2088fe719dd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 639dd02e-77b1-44c5-bb10-e9604a99b455, kind: Service { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 }, name: Name("nexus-0d502811-de24-4e27-b92c-fccb5bf9f798"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5ae62a3-3cee-4a00-a285-de4030662fb7, kind: Service { id: cfce6b5d-973c-4736-93fb-e3347600566b }, name: Name("nexus-cfce6b5d-973c-4736-93fb-e3347600566b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19442024-11-07T02:43:37.497ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19452024-11-07T02:43:37.498ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19462024-11-07T02:43:37.498ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19472024-11-07T02:43:37.498ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19482024-11-07T02:43:37.498ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19492024-11-07T02:43:37.498ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19502024-11-07T02:43:37.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64477 req_id = ac409ad1-2c59-44ac-94d0-cb5300807384 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19512024-11-07T02:43:37.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45172
19522024-11-07T02:43:37.606ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
19532024-11-07T02:43:37.606ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
19542024-11-07T02:43:37.606ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:177
19552024-11-07T02:43:37.606ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:177
19562024-11-07T02:43:37.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 235168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45172 req_id = c6e62a11-57a9-41c8-a0e4-7c2559cb9c89 response_code = 200 uri = /inventory
19572024-11-07T02:43:39.180ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57750
19582024-11-07T02:43:39.180ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57750 req_id = df3326d7-1188-4d2c-8e47-2aa6fa96cff7 response_code = 200 uri = /baseboard
19592024-11-07T02:43:42.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64920
19602024-11-07T02:43:42.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64920 req_id = f7dcf7b3-900e-45d3-8dc7-e7633b28e00a response_code = 200 uri = /vpc-routes
19612024-11-07T02:43:42.410ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
19622024-11-07T02:43:42.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64920 req_id = 987deb92-bd17-4d30-9336-8529a6121c5e response_code = 204 uri = /eip-gateways
19632024-11-07T02:43:42.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64920 req_id = 739616ff-ba9a-43af-a89f-993602f13b10 response_code = 204 uri = /vpc-routes
19642024-11-07T02:44:02.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45461
19652024-11-07T02:44:02.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45461 req_id = 86248789-ad35-4836-8259-ec711acec275 response_code = 200 uri = /vpc-routes
19662024-11-07T02:44:02.254ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
19672024-11-07T02:44:02.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45461 req_id = beead263-4e5a-47bb-98f0-737b53909b68 response_code = 204 uri = /eip-gateways
19682024-11-07T02:44:02.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45461 req_id = a2247a7d-75de-494d-9219-e4deca8e8f2e response_code = 204 uri = /vpc-routes
19692024-11-07T02:44:02.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57547
19702024-11-07T02:44:02.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57547 req_id = 7512f7d2-c248-487d-be4c-8669eee6ba99 response_code = 200 uri = /v2p
19712024-11-07T02:44:02.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58408
19722024-11-07T02:44:02.466ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
19732024-11-07T02:44:02.527ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
19742024-11-07T02:44:02.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118712 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58408 req_id = 0e29b660-6c35-474e-9a94-fe5750a3b197 response_code = 204 uri = /switch-ports
19752024-11-07T02:44:02.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58408 req_id = 2c15cf74-7fa3-4521-bee6-dc76664729d3 response_code = 200 uri = /network-bootstore-config
19762024-11-07T02:44:02.628ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19772024-11-07T02:44:02.628ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19782024-11-07T02:44:02.629ZINFOSledAgent (bootstore): Writing ledger to /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19792024-11-07T02:44:02.631ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19802024-11-07T02:44:02.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58408 req_id = d2e9eca1-6684-460f-8aa3-6498deaccee8 response_code = 204 uri = /network-bootstore-config
19812024-11-07T02:44:03.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35160
19822024-11-07T02:44:03.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35160 req_id = 3a15963d-2e76-4fc4-8f0a-dfddfec65726 response_code = 200 uri = /vpc-routes
19832024-11-07T02:44:03.214ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
19842024-11-07T02:44:03.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35160 req_id = 384cd73e-1304-4403-9316-ec3ce0f9cb61 response_code = 204 uri = /eip-gateways
19852024-11-07T02:44:03.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52468
19862024-11-07T02:44:03.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52468 req_id = f00ed4ee-bd4a-46af-937c-b7e9bc1eb091 response_code = 200 uri = /v2p
19872024-11-07T02:44:03.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41442
19882024-11-07T02:44:03.274ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
19892024-11-07T02:44:03.318ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
19902024-11-07T02:44:03.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102957 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41442 req_id = 29a357ac-b61a-40a9-8870-99e0eb0e4f7b response_code = 204 uri = /switch-ports
19912024-11-07T02:44:03.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43059
19922024-11-07T02:44:03.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35160 req_id = 66c10646-45c8-44ed-ac8c-74c369b432c1 response_code = 204 uri = /vpc-routes
19932024-11-07T02:44:03.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41442 req_id = e688d421-b460-476a-be56-abe5a8b79ce0 response_code = 200 uri = /network-bootstore-config
19942024-11-07T02:44:03.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43059 req_id = 581a7167-046b-465b-9b8a-865a66c97d5a response_code = 200 uri = /vpc-routes
19952024-11-07T02:44:03.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50741
19962024-11-07T02:44:03.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50741 req_id = 86026b5a-0af9-4530-b1d7-06f889f0a5c9 response_code = 200 uri = /v2p
19972024-11-07T02:44:03.463ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
19982024-11-07T02:44:03.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43059 req_id = 37aaa604-628e-4f21-b195-f162f9fc1fb0 response_code = 204 uri = /eip-gateways
19992024-11-07T02:44:03.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43059 req_id = c09b3a58-2555-427e-b571-9a4342160fcf response_code = 204 uri = /vpc-routes
20002024-11-07T02:44:03.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33246
20012024-11-07T02:44:03.549ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20022024-11-07T02:44:03.587ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20032024-11-07T02:44:03.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91141 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33246 req_id = fab9a77e-4385-4244-bc45-f30ff85499fe response_code = 204 uri = /switch-ports
20042024-11-07T02:44:03.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33246 req_id = abdff900-5843-4b77-8fcf-60e3d59b04f4 response_code = 200 uri = /network-bootstore-config
20052024-11-07T02:44:09.215ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57513
20062024-11-07T02:44:09.215ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57513 req_id = b47a5b6b-769e-4abe-a15b-9e198b0b7cd6 response_code = 200 uri = /baseboard
20072024-11-07T02:44:24.785ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:48082 remote_addr = [fd00:1122:3344:101::d]:54071 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
20082024-11-07T02:44:24.806ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 20363 local_addr = [fd00:1122:3344:101::1]:48082 method = GET remote_addr = [fd00:1122:3344:101::d]:54071 req_id = 180ae0c4-7c7d-4d37-846f-5fe794c7a0b6 response_code = 200 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 uri = /ed4702f9-ad41-4221-9a83-4f7d256be0d9
20092024-11-07T02:44:32.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48776
20102024-11-07T02:44:32.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48776 req_id = e2e13d9c-f00b-4f70-b0db-b3663713cacf response_code = 200 uri = /vpc-routes
20112024-11-07T02:44:32.427ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
20122024-11-07T02:44:32.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48776 req_id = b37f44fb-0605-4fdf-bf21-1a74111b32de response_code = 204 uri = /eip-gateways
20132024-11-07T02:44:32.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48776 req_id = ba597102-7f81-4801-97a5-b9b6e1b9ef53 response_code = 204 uri = /vpc-routes
20142024-11-07T02:44:32.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34810
20152024-11-07T02:44:32.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34810 req_id = 22bfe958-be3f-4007-99c4-007184247ea8 response_code = 200 uri = /v2p
20162024-11-07T02:44:32.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49036
20172024-11-07T02:44:32.645ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20182024-11-07T02:44:32.680ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20192024-11-07T02:44:32.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89379 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49036 req_id = b106ae85-d19b-4a30-b50f-a520d579ffdc response_code = 204 uri = /switch-ports
20202024-11-07T02:44:32.734ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20212024-11-07T02:44:32.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49036 req_id = 5b269646-b4fc-4c71-a2c5-31ca0506e963 response_code = 200 uri = /network-bootstore-config
20222024-11-07T02:44:33.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41803
20232024-11-07T02:44:33.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41803 req_id = d26237e0-7967-4ea9-8a8f-b26f57c20367 response_code = 200 uri = /vpc-routes
20242024-11-07T02:44:33.333ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
20252024-11-07T02:44:33.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41803 req_id = 603163a2-f870-48db-9f58-eec948232ab6 response_code = 204 uri = /eip-gateways
20262024-11-07T02:44:33.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41803 req_id = 5d47a7e7-de79-4a3d-9c94-31048aa8a737 response_code = 204 uri = /vpc-routes
20272024-11-07T02:44:33.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49493
20282024-11-07T02:44:33.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49493 req_id = e646ffb0-63f2-41f4-b661-92e3f0bb2eb8 response_code = 200 uri = /vpc-routes
20292024-11-07T02:44:33.424ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
20302024-11-07T02:44:33.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49493 req_id = ffd0f38e-98b1-4365-b20a-88d646103049 response_code = 204 uri = /eip-gateways
20312024-11-07T02:44:33.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65323
20322024-11-07T02:44:33.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65323 req_id = 60d59fd3-c309-4071-a006-ad4f951f4428 response_code = 200 uri = /v2p
20332024-11-07T02:44:33.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59806
20342024-11-07T02:44:33.487ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20352024-11-07T02:44:33.530ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20362024-11-07T02:44:33.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109132 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59806 req_id = d6646c03-95e4-4fcf-81e6-483489eff710 response_code = 204 uri = /switch-ports
20372024-11-07T02:44:33.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63088
20382024-11-07T02:44:33.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59806 req_id = 703d752e-8d72-4c60-8bc8-c1962a8a27c6 response_code = 200 uri = /network-bootstore-config
20392024-11-07T02:44:33.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 422 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49493 req_id = 45d5385f-f65b-4945-b7d7-7c31cbe4deb9 response_code = 204 uri = /vpc-routes
20402024-11-07T02:44:33.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63088 req_id = 07c64b94-82ae-4fc0-acd0-784af3fa3df6 response_code = 200 uri = /v2p
20412024-11-07T02:44:33.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46862
20422024-11-07T02:44:33.941ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20432024-11-07T02:44:33.981ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20442024-11-07T02:44:34.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99556 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46862 req_id = b9b1945a-8bfa-4101-ba23-56305889dd9d response_code = 204 uri = /switch-ports
20452024-11-07T02:44:34.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46862 req_id = 5b2d2919-6dac-4cd5-bba3-2d34d5e2dd7d response_code = 200 uri = /network-bootstore-config
20462024-11-07T02:44:39.248ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45581
20472024-11-07T02:44:39.248ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45581 req_id = eb182909-86af-48f7-8f13-5a76025b478d response_code = 200 uri = /baseboard
20482024-11-07T02:45:02.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45628
20492024-11-07T02:45:02.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45628 req_id = da2da239-45e6-47cc-9dd0-14661aaa0b3e response_code = 200 uri = /vpc-routes
20502024-11-07T02:45:02.302ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
20512024-11-07T02:45:02.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45628 req_id = 8249799b-bfa6-46ad-8526-9a9e6245ff9b response_code = 204 uri = /eip-gateways
20522024-11-07T02:45:02.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45628 req_id = 9319f8cc-83d4-49fe-8964-aecdeaae9894 response_code = 204 uri = /vpc-routes
20532024-11-07T02:45:02.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55583
20542024-11-07T02:45:02.342ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20552024-11-07T02:45:02.398ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20562024-11-07T02:45:02.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138541 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55583 req_id = 7594d0e3-aa23-4214-ae1f-6e95866782ff response_code = 204 uri = /switch-ports
20572024-11-07T02:45:02.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46209
20582024-11-07T02:45:02.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55583 req_id = 47e2e7f9-6d5a-4d08-abc8-86c7a0221ccf response_code = 200 uri = /network-bootstore-config
20592024-11-07T02:45:02.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46209 req_id = 79bd2650-e404-4006-920d-54d24b98ec7c response_code = 200 uri = /v2p
20602024-11-07T02:45:03.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56298
20612024-11-07T02:45:03.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56298 req_id = b3c3f228-31d2-4282-8df7-5e96f94800e3 response_code = 200 uri = /vpc-routes
20622024-11-07T02:45:03.270ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
20632024-11-07T02:45:03.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56298 req_id = ad171e6a-4ab6-4e5d-8d04-a87ebb8fc56d response_code = 204 uri = /eip-gateways
20642024-11-07T02:45:03.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56298 req_id = 7cdaa946-1d00-4431-b4ed-85e795fb86bc response_code = 204 uri = /vpc-routes
20652024-11-07T02:45:03.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36095
20662024-11-07T02:45:03.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36095 req_id = 442b9899-a4e3-462d-b338-3ce1cd5e8657 response_code = 200 uri = /v2p
20672024-11-07T02:45:03.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55807
20682024-11-07T02:45:03.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55807 req_id = 0e510537-73b9-42d5-a507-17e6f7e8138f response_code = 200 uri = /vpc-routes
20692024-11-07T02:45:03.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43610
20702024-11-07T02:45:03.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43610 req_id = 8a3356da-8f52-4169-8ba6-a69480ae5c13 response_code = 200 uri = /v2p
20712024-11-07T02:45:03.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60025
20722024-11-07T02:45:03.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20732024-11-07T02:45:03.414ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20742024-11-07T02:45:03.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94629 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60025 req_id = 426859c0-81b0-4b97-8da9-0dd26ec3ba15 response_code = 204 uri = /switch-ports
20752024-11-07T02:45:03.469ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
20762024-11-07T02:45:03.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55807 req_id = ebcc4029-bcb9-4300-873d-3741a8a40426 response_code = 204 uri = /eip-gateways
20772024-11-07T02:45:03.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60025 req_id = 8db3f379-b520-4606-a607-9c2dcbbaf8b3 response_code = 200 uri = /network-bootstore-config
20782024-11-07T02:45:03.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44080
20792024-11-07T02:45:03.504ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20802024-11-07T02:45:03.541ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20812024-11-07T02:45:03.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93443 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44080 req_id = c5f2e97e-7e1d-4727-ac04-6b2de2cdc391 response_code = 204 uri = /switch-ports
20822024-11-07T02:45:03.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44080 req_id = 4ca5f84a-7b5a-4303-98dc-349428e87600 response_code = 200 uri = /network-bootstore-config
20832024-11-07T02:45:03.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55807 req_id = 1fe2f97e-e2f9-49b6-9682-c8bac04542bb response_code = 204 uri = /vpc-routes
20842024-11-07T02:45:09.282ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63774
20852024-11-07T02:45:09.282ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63774 req_id = d71f73bb-be56-4c7a-93a7-7f600623c50a response_code = 200 uri = /baseboard
20862024-11-07T02:45:32.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50559
20872024-11-07T02:45:32.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50559 req_id = e60b662a-0ede-4555-a813-6c189e934bf7 response_code = 200 uri = /vpc-routes
20882024-11-07T02:45:32.371ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
20892024-11-07T02:45:32.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50559 req_id = f9ce6ce7-a078-42f0-a04c-94136963df16 response_code = 204 uri = /eip-gateways
20902024-11-07T02:45:32.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50559 req_id = 4d024c83-0dd4-445b-aa99-d4235de95c22 response_code = 204 uri = /vpc-routes
20912024-11-07T02:45:32.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44864
20922024-11-07T02:45:32.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44864 req_id = 8a39f19c-6ef7-45d3-8699-c4bdcd991cde response_code = 200 uri = /v2p
20932024-11-07T02:45:32.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58489
20942024-11-07T02:45:32.839ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20952024-11-07T02:45:32.876ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20962024-11-07T02:45:32.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93490 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58489 req_id = 848d7a3b-e2e0-4c9b-8257-8ad9ed83bbfc response_code = 204 uri = /switch-ports
20972024-11-07T02:45:32.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58489 req_id = 5c6e3455-44be-444a-b05e-d05ae4f735c5 response_code = 200 uri = /network-bootstore-config
20982024-11-07T02:45:33.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36557
20992024-11-07T02:45:33.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36557 req_id = 39521e8c-ee33-4207-b96c-0e3d3afed12f response_code = 200 uri = /vpc-routes
21002024-11-07T02:45:33.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51914
21012024-11-07T02:45:33.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51914 req_id = 822d8298-da4d-497a-85b9-a027195e76bf response_code = 200 uri = /v2p
21022024-11-07T02:45:33.343ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
21032024-11-07T02:45:33.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36557 req_id = 437a1f71-893e-45d1-a38c-63da5f547691 response_code = 204 uri = /eip-gateways
21042024-11-07T02:45:33.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36557 req_id = 8ec1d76a-4ca4-48ed-89b2-5dc653ae8bf6 response_code = 204 uri = /vpc-routes
21052024-11-07T02:45:33.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44719
21062024-11-07T02:45:33.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44719 req_id = e8120da5-433e-4247-b35b-69d4943dc13d response_code = 200 uri = /vpc-routes
21072024-11-07T02:45:33.426ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
21082024-11-07T02:45:33.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44719 req_id = acc6fbb2-8906-44d1-abb6-f12822c66610 response_code = 204 uri = /eip-gateways
21092024-11-07T02:45:33.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34420
21102024-11-07T02:45:33.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34420 req_id = a745e190-8cfd-4cc8-98a3-b3f1eebc137a response_code = 200 uri = /v2p
21112024-11-07T02:45:33.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44719 req_id = 054e11b3-140a-4ff3-9afe-01945204487b response_code = 204 uri = /vpc-routes
21122024-11-07T02:45:33.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57633
21132024-11-07T02:45:33.764ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21142024-11-07T02:45:33.802ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21152024-11-07T02:45:33.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57633 req_id = 6e69f27f-9ad2-414c-96dd-a38b197b1ede response_code = 204 uri = /switch-ports
21162024-11-07T02:45:33.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55304
21172024-11-07T02:45:33.854ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21182024-11-07T02:45:33.887ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21192024-11-07T02:45:33.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84747 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55304 req_id = cbbc4e32-b0bc-4a91-bbb7-7d8110bfd7d9 response_code = 204 uri = /switch-ports
21202024-11-07T02:45:33.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57633 req_id = 10b0e226-5351-442d-be80-931efc9c63e6 response_code = 200 uri = /network-bootstore-config
21212024-11-07T02:45:33.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55304 req_id = c80a506c-3b93-4c49-b8ab-ec9ae5537787 response_code = 200 uri = /network-bootstore-config
21222024-11-07T02:45:39.315ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45152
21232024-11-07T02:45:39.315ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45152 req_id = 555154d2-12fc-4f6d-838e-5f49221a2cc4 response_code = 200 uri = /baseboard
21242024-11-07T02:46:02.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38193
21252024-11-07T02:46:02.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38193 req_id = 965ded1e-ad1f-4282-a613-8fb73fe50b6a response_code = 200 uri = /vpc-routes
21262024-11-07T02:46:02.291ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
21272024-11-07T02:46:02.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38193 req_id = 160974c7-cda4-4466-9013-de3cfe36f925 response_code = 204 uri = /eip-gateways
21282024-11-07T02:46:02.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38193 req_id = b0bb0635-cf3e-47bd-b3a5-b013327b7490 response_code = 204 uri = /vpc-routes
21292024-11-07T02:46:02.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46957
21302024-11-07T02:46:02.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46957 req_id = 1d0d917b-331e-48da-8468-8f1183562873 response_code = 200 uri = /v2p
21312024-11-07T02:46:02.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58615
21322024-11-07T02:46:02.414ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21332024-11-07T02:46:02.454ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21342024-11-07T02:46:02.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97343 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58615 req_id = bf58080e-acc9-4573-9a19-fba4dfc9f83c response_code = 204 uri = /switch-ports
21352024-11-07T02:46:02.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58615 req_id = f90c834b-c82b-4c25-8129-062c0ccb13a7 response_code = 200 uri = /network-bootstore-config
21362024-11-07T02:46:03.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33835
21372024-11-07T02:46:03.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33835 req_id = 3943124e-16b4-49a3-a5f6-29ff7e7bf453 response_code = 200 uri = /vpc-routes
21382024-11-07T02:46:03.251ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
21392024-11-07T02:46:03.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33835 req_id = d30234f1-6f32-4833-8bec-5bb5956cbfd7 response_code = 204 uri = /eip-gateways
21402024-11-07T02:46:03.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33835 req_id = f64b259e-84aa-40a8-80e1-9f2bc61b9823 response_code = 204 uri = /vpc-routes
21412024-11-07T02:46:03.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55715
21422024-11-07T02:46:03.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55715 req_id = 6346f18a-ab61-4594-95ff-e52b3d27fd54 response_code = 200 uri = /v2p
21432024-11-07T02:46:03.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61446
21442024-11-07T02:46:03.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61446 req_id = bb30e997-f2f4-450a-a1a4-1a5d5e616f4f response_code = 200 uri = /vpc-routes
21452024-11-07T02:46:03.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
21462024-11-07T02:46:03.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61446 req_id = b6a0adf7-397c-42ac-997b-2d6f4ae32a2b response_code = 204 uri = /eip-gateways
21472024-11-07T02:46:03.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54684
21482024-11-07T02:46:03.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54684 req_id = 8a2fe083-355a-4806-a214-026f8932a39e response_code = 200 uri = /v2p
21492024-11-07T02:46:03.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61446 req_id = 22eea8dd-00bf-4930-905b-40ec4ef24249 response_code = 204 uri = /vpc-routes
21502024-11-07T02:46:03.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45327
21512024-11-07T02:46:03.457ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21522024-11-07T02:46:03.495ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21532024-11-07T02:46:03.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98100 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45327 req_id = 0dd63c39-cf5c-472b-acbd-43e9a1d3d4f5 response_code = 204 uri = /switch-ports
21542024-11-07T02:46:03.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45327 req_id = 9bf9c586-bb18-4e5a-be87-c1aa906fd121 response_code = 200 uri = /network-bootstore-config
21552024-11-07T02:46:03.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39510
21562024-11-07T02:46:03.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21572024-11-07T02:46:03.624ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21582024-11-07T02:46:03.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93640 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39510 req_id = 297e7568-061d-432e-8667-34a1466e5a5c response_code = 204 uri = /switch-ports
21592024-11-07T02:46:03.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39510 req_id = 6ca98e6b-2bc6-48ef-b917-8bdf04345739 response_code = 200 uri = /network-bootstore-config
21602024-11-07T02:46:09.350ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54914
21612024-11-07T02:46:09.350ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54914 req_id = ea866a44-6d57-43bd-8033-4b5ffd46ab88 response_code = 200 uri = /baseboard
21622024-11-07T02:46:32.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38686
21632024-11-07T02:46:32.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38686 req_id = 3641bf5c-96ac-450f-a475-2012b5c25903 response_code = 200 uri = /vpc-routes
21642024-11-07T02:46:32.421ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
21652024-11-07T02:46:32.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38686 req_id = a4643c0e-1206-4b17-a028-bd6611e895e1 response_code = 204 uri = /eip-gateways
21662024-11-07T02:46:32.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38686 req_id = 11f7823e-fe01-4a23-bbe6-508b4a41d85e response_code = 204 uri = /vpc-routes
21672024-11-07T02:46:32.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45671
21682024-11-07T02:46:32.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45671 req_id = 5e83d6cb-cdd0-4846-a6ff-331d8438b026 response_code = 200 uri = /v2p
21692024-11-07T02:46:32.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39151
21702024-11-07T02:46:32.599ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21712024-11-07T02:46:32.634ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21722024-11-07T02:46:32.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87084 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39151 req_id = 1fefe872-368e-4ca7-a5d2-2c694382c486 response_code = 204 uri = /switch-ports
21732024-11-07T02:46:32.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39151 req_id = 469b35cc-b317-4091-b608-410a128bb65c response_code = 200 uri = /network-bootstore-config
21742024-11-07T02:46:33.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61894
21752024-11-07T02:46:33.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61894 req_id = 255f6574-60dc-4aec-af3d-57c029a09d72 response_code = 200 uri = /vpc-routes
21762024-11-07T02:46:33.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40715
21772024-11-07T02:46:33.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40715 req_id = bec08090-90e3-44ce-9762-b5a82e7fbc69 response_code = 200 uri = /v2p
21782024-11-07T02:46:33.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
21792024-11-07T02:46:33.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61894 req_id = c3deb566-721b-4c07-abb1-4a235d7db262 response_code = 204 uri = /eip-gateways
21802024-11-07T02:46:33.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51842
21812024-11-07T02:46:33.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51842 req_id = f53f240c-7a72-40e5-b07b-42d77661e2ae response_code = 200 uri = /v2p
21822024-11-07T02:46:33.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51391
21832024-11-07T02:46:33.519ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21842024-11-07T02:46:33.562ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21852024-11-07T02:46:33.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105721 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51391 req_id = 04c4c1df-d904-404e-bc5d-3b6fb321708b response_code = 204 uri = /switch-ports
21862024-11-07T02:46:33.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48241
21872024-11-07T02:46:33.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48241 req_id = b4accaf4-d34e-4e14-a219-afff9a5ca5ae response_code = 200 uri = /vpc-routes
21882024-11-07T02:46:33.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51391 req_id = 04840d47-76e5-4a67-9ddd-de1a8115c93a response_code = 200 uri = /network-bootstore-config
21892024-11-07T02:46:33.640ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
21902024-11-07T02:46:33.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48241 req_id = 66f39792-09a5-4417-b765-3bcc2dfbeb17 response_code = 204 uri = /eip-gateways
21912024-11-07T02:46:33.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48241 req_id = 500e2e14-12f3-4a0d-8be7-1539d7212c1c response_code = 204 uri = /vpc-routes
21922024-11-07T02:46:33.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33743
21932024-11-07T02:46:33.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21942024-11-07T02:46:33.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4604 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61894 req_id = ec558ca2-6689-4761-8491-4914b9822e5c response_code = 204 uri = /vpc-routes
21952024-11-07T02:46:33.735ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21962024-11-07T02:46:33.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91983 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33743 req_id = 032d61f3-6a97-406d-a6c6-d9bbfe2cce9a response_code = 204 uri = /switch-ports
21972024-11-07T02:46:33.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33743 req_id = d80de0e8-fdd6-406a-b865-af5277a5f6ba response_code = 200 uri = /network-bootstore-config
21982024-11-07T02:46:39.385ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62076
21992024-11-07T02:46:39.385ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62076 req_id = f3003357-3aaf-494a-986a-31ec5fdb1c6f response_code = 200 uri = /baseboard
22002024-11-07T02:47:02.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36401
22012024-11-07T02:47:02.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36401 req_id = b8f4794f-f810-45b3-aa44-f43229284d4f response_code = 200 uri = /vpc-routes
22022024-11-07T02:47:02.172ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
22032024-11-07T02:47:02.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36401 req_id = fb37c7e8-d0df-4570-aa71-9bec1f3b68d2 response_code = 204 uri = /eip-gateways
22042024-11-07T02:47:02.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36401 req_id = 57137c33-a979-4db4-966d-7a6b31cae64b response_code = 204 uri = /vpc-routes
22052024-11-07T02:47:02.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61416
22062024-11-07T02:47:02.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61416 req_id = 1fc8685e-0633-4861-8428-22721896d7e2 response_code = 200 uri = /v2p
22072024-11-07T02:47:02.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56570
22082024-11-07T02:47:02.324ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22092024-11-07T02:47:02.360ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22102024-11-07T02:47:02.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56570 req_id = db52b556-66eb-420d-9c53-4eb28b528c3b response_code = 204 uri = /switch-ports
22112024-11-07T02:47:02.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56570 req_id = 8862a3e3-4337-455b-bb0f-f2790aa2c8c4 response_code = 200 uri = /network-bootstore-config
22122024-11-07T02:47:03.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47284
22132024-11-07T02:47:03.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47284 req_id = 526fa066-4dd2-481f-a864-f0a0ba16340b response_code = 200 uri = /vpc-routes
22142024-11-07T02:47:03.215ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
22152024-11-07T02:47:03.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47284 req_id = afd2b3ab-948e-43bd-afe8-3ebb944b3151 response_code = 204 uri = /eip-gateways
22162024-11-07T02:47:03.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47284 req_id = 85731efa-9faf-4211-ace2-ea2751dd5e6c response_code = 204 uri = /vpc-routes
22172024-11-07T02:47:03.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43184
22182024-11-07T02:47:03.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43184 req_id = f87c9434-eab6-4aff-bea8-21d35ec8d05f response_code = 200 uri = /vpc-routes
22192024-11-07T02:47:03.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56953
22202024-11-07T02:47:03.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56953 req_id = 4d9401b9-3a7d-4298-8972-0a11bf956625 response_code = 200 uri = /v2p
22212024-11-07T02:47:03.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43860
22222024-11-07T02:47:03.337ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22232024-11-07T02:47:03.376ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22242024-11-07T02:47:03.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93779 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43860 req_id = 6589ab64-752e-46ab-803b-a502809eb71c response_code = 204 uri = /switch-ports
22252024-11-07T02:47:03.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34809
22262024-11-07T02:47:03.431ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
22272024-11-07T02:47:03.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43184 req_id = 8351c9e3-1f97-4906-acc2-12133bf74058 response_code = 204 uri = /eip-gateways
22282024-11-07T02:47:03.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43860 req_id = 33478216-0647-4309-b85e-2bb6cd9ae233 response_code = 200 uri = /network-bootstore-config
22292024-11-07T02:47:03.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34809 req_id = d69d0d72-7c03-4a64-b6a0-9755e453c3a4 response_code = 200 uri = /v2p
22302024-11-07T02:47:03.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43184 req_id = b82e8400-c690-4d1f-8064-04d35bb3e105 response_code = 204 uri = /vpc-routes
22312024-11-07T02:47:03.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61301
22322024-11-07T02:47:03.528ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22332024-11-07T02:47:03.566ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22342024-11-07T02:47:03.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61301 req_id = 5b0dc9da-6179-4f57-932e-4e56a8c30f74 response_code = 204 uri = /switch-ports
22352024-11-07T02:47:03.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61301 req_id = 04613ed7-4c0b-4369-9e72-afc3383408dd response_code = 200 uri = /network-bootstore-config
22362024-11-07T02:47:09.418ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34517
22372024-11-07T02:47:09.419ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34517 req_id = e13f804b-5b38-4029-9616-28fb8e57ddbd response_code = 200 uri = /baseboard
22382024-11-07T02:47:32.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48187
22392024-11-07T02:47:32.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48187 req_id = ede121b0-372a-417f-908d-eca023605fe1 response_code = 200 uri = /vpc-routes
22402024-11-07T02:47:32.334ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
22412024-11-07T02:47:32.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48187 req_id = 912291d1-d90e-4c47-8136-a82b754e76b8 response_code = 204 uri = /eip-gateways
22422024-11-07T02:47:32.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48187 req_id = aa07058a-37b6-4008-a2ed-298c249a25e5 response_code = 204 uri = /vpc-routes
22432024-11-07T02:47:32.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55087
22442024-11-07T02:47:32.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55087 req_id = df766568-391e-4268-b5b7-f1b80f215aaf response_code = 200 uri = /v2p
22452024-11-07T02:47:32.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43407
22462024-11-07T02:47:32.733ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22472024-11-07T02:47:32.771ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22482024-11-07T02:47:32.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43407 req_id = c9e9e185-c54a-4e5d-a0bc-11a9d01297a8 response_code = 204 uri = /switch-ports
22492024-11-07T02:47:32.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43407 req_id = fff0c711-3307-4604-9550-d11c5c3924a7 response_code = 200 uri = /network-bootstore-config
22502024-11-07T02:47:33.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48092
22512024-11-07T02:47:33.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48092 req_id = 328e05a5-131d-4b15-a4b2-afb79ba19e8d response_code = 200 uri = /vpc-routes
22522024-11-07T02:47:33.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
22532024-11-07T02:47:33.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48092 req_id = ec496fb0-fd1a-4591-9c0a-8ec981b8532b response_code = 204 uri = /eip-gateways
22542024-11-07T02:47:33.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65217
22552024-11-07T02:47:33.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65217 req_id = e4a8b3f2-6bf3-4a6f-b31e-40f433a755a3 response_code = 200 uri = /vpc-routes
22562024-11-07T02:47:33.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48092 req_id = 2f8257ba-ab5b-4539-88c9-2e153b3a83cb response_code = 204 uri = /vpc-routes
22572024-11-07T02:47:33.477ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
22582024-11-07T02:47:33.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65217 req_id = cd00f368-5987-47c0-b225-fe80a2146858 response_code = 204 uri = /eip-gateways
22592024-11-07T02:47:33.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65217 req_id = 80d300cd-c81a-4928-94a7-70d8aaf357b5 response_code = 204 uri = /vpc-routes
22602024-11-07T02:47:33.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53085
22612024-11-07T02:47:33.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53085 req_id = 756156cb-e354-486e-926c-c821bf2a2ac2 response_code = 200 uri = /v2p
22622024-11-07T02:47:33.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42922
22632024-11-07T02:47:33.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42922 req_id = a2cae0ed-dd2b-4712-be19-38c207c692f5 response_code = 200 uri = /v2p
22642024-11-07T02:47:33.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38421
22652024-11-07T02:47:33.576ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22662024-11-07T02:47:33.610ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22672024-11-07T02:47:33.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82660 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38421 req_id = 340148aa-7cda-4bf1-887f-89f436ec1ce5 response_code = 204 uri = /switch-ports
22682024-11-07T02:47:33.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46503
22692024-11-07T02:47:33.659ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22702024-11-07T02:47:33.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3095 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38421 req_id = a013c22e-a1c7-4786-a6a9-a9d0a4228b43 response_code = 200 uri = /network-bootstore-config
22712024-11-07T02:47:33.691ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22722024-11-07T02:47:33.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102065 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46503 req_id = dbaebcf0-5188-493f-be15-c7fb99c0e995 response_code = 204 uri = /switch-ports
22732024-11-07T02:47:33.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46503 req_id = c1fc6075-c0ea-44f4-997f-2ffa6b39e1db response_code = 200 uri = /network-bootstore-config
22742024-11-07T02:47:39.451ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51107
22752024-11-07T02:47:39.451ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51107 req_id = 93e1e27d-c15d-4b2b-931c-fcd472c31709 response_code = 200 uri = /baseboard
22762024-11-07T02:48:02.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58109
22772024-11-07T02:48:02.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58109 req_id = 2ac6056f-d8b1-4ad4-8e4b-b62464e1580e response_code = 200 uri = /vpc-routes
22782024-11-07T02:48:02.248ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
22792024-11-07T02:48:02.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58109 req_id = e0b80702-3ed8-40b9-9c66-6453c925c949 response_code = 204 uri = /eip-gateways
22802024-11-07T02:48:02.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58109 req_id = a1077f2a-5076-4578-b5ed-06b728b0c5bb response_code = 204 uri = /vpc-routes
22812024-11-07T02:48:02.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42336
22822024-11-07T02:48:02.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42336 req_id = 9d7cfeb8-5d15-4b68-aeae-bbbb6858838d response_code = 200 uri = /v2p
22832024-11-07T02:48:02.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55805
22842024-11-07T02:48:02.316ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22852024-11-07T02:48:02.356ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22862024-11-07T02:48:02.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97169 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55805 req_id = 33c942a8-552e-45e0-adff-406d63f53086 response_code = 204 uri = /switch-ports
22872024-11-07T02:48:02.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55805 req_id = f0013690-7b62-47a0-ab35-8c7e13fa89fd response_code = 200 uri = /network-bootstore-config
22882024-11-07T02:48:03.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33506
22892024-11-07T02:48:03.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33506 req_id = 9a378fd8-beff-42b3-8576-7ad6c9caa859 response_code = 200 uri = /vpc-routes
22902024-11-07T02:48:03.200ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
22912024-11-07T02:48:03.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33506 req_id = 34963227-7c34-484a-bdb1-366eefad6250 response_code = 204 uri = /eip-gateways
22922024-11-07T02:48:03.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33506 req_id = ac698cf5-0e70-47b3-9b53-a917333906da response_code = 204 uri = /vpc-routes
22932024-11-07T02:48:03.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65435
22942024-11-07T02:48:03.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65435 req_id = 89f09d73-a4c0-4d32-a701-41278a161aca response_code = 200 uri = /v2p
22952024-11-07T02:48:03.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36446
22962024-11-07T02:48:03.303ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22972024-11-07T02:48:03.339ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22982024-11-07T02:48:03.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99568 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36446 req_id = 1f0b0cc3-acf5-4137-b897-e32ba1595fc4 response_code = 204 uri = /switch-ports
22992024-11-07T02:48:03.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43405
23002024-11-07T02:48:03.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63856
23012024-11-07T02:48:03.403ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23022024-11-07T02:48:03.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3768 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36446 req_id = 4b32a9f2-b658-4b57-b41e-7ad3a69947ba response_code = 200 uri = /network-bootstore-config
23032024-11-07T02:48:03.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3635 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43405 req_id = 4507dbbb-c46d-44fb-8d66-1e26eca2c6ea response_code = 200 uri = /vpc-routes
23042024-11-07T02:48:03.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51130
23052024-11-07T02:48:03.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51130 req_id = a64f3877-a899-49e5-8fac-139318ce9bdd response_code = 200 uri = /v2p
23062024-11-07T02:48:03.441ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23072024-11-07T02:48:03.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
23082024-11-07T02:48:03.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43405 req_id = abc3e5d9-74f7-4853-95d7-259c3e781267 response_code = 204 uri = /eip-gateways
23092024-11-07T02:48:03.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43405 req_id = 18a81f4c-0da6-4345-ab9d-5626917f7c5d response_code = 204 uri = /vpc-routes
23102024-11-07T02:48:03.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63856 req_id = b3610562-29d3-4df7-8b37-e2195039e9b0 response_code = 204 uri = /switch-ports
23112024-11-07T02:48:03.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63856 req_id = 0b16b85b-de5c-4087-b429-94b5219f2480 response_code = 200 uri = /network-bootstore-config
23122024-11-07T02:48:09.484ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33650
23132024-11-07T02:48:09.484ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33650 req_id = a2015e42-c174-4af0-b4cf-c3a43e85e99a response_code = 200 uri = /baseboard
23142024-11-07T02:48:32.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37400
23152024-11-07T02:48:32.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37400 req_id = 50e18e9b-9705-49de-a1db-e4855ec27a1b response_code = 200 uri = /vpc-routes
23162024-11-07T02:48:32.350ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
23172024-11-07T02:48:32.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37400 req_id = 885b329c-d15f-4eff-975e-27a7a2c2b653 response_code = 204 uri = /eip-gateways
23182024-11-07T02:48:32.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45355
23192024-11-07T02:48:32.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45355 req_id = 08c245fe-ea67-40b8-8c2b-1d13202bd8e9 response_code = 200 uri = /v2p
23202024-11-07T02:48:32.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37400 req_id = c79f0cd3-e1de-425c-9d3b-c5beda4e1f15 response_code = 204 uri = /vpc-routes
23212024-11-07T02:48:32.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41892
23222024-11-07T02:48:32.515ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23232024-11-07T02:48:32.554ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23242024-11-07T02:48:32.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99474 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41892 req_id = 7dd6b437-88fa-42d1-b4a1-c31e25f2fcee response_code = 204 uri = /switch-ports
23252024-11-07T02:48:32.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41892 req_id = 14919526-53a5-4b02-bcdb-0877306e3a48 response_code = 200 uri = /network-bootstore-config
23262024-11-07T02:48:32.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55402
23272024-11-07T02:48:32.700ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e6dcf98-e56c-4c04-9515-6f635bc8207c, kind: Service { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 }, name: Name("external-dns-81e03cb2-6bdf-4324-a5c8-541c23e034b9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b0270c81-c1ae-4f80-b64a-fc343b0f5d05, kind: Service { id: f2257614-9856-4344-bdd9-897edf2a5e03 }, name: Name("external-dns-f2257614-9856-4344-bdd9-897edf2a5e03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5babe071-e49d-4d68-8a86-a6faf41174c4, kind: Service { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 }, name: Name("nexus-585aaa98-c3b7-4a1f-979c-2088fe719dd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 639dd02e-77b1-44c5-bb10-e9604a99b455, kind: Service { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 }, name: Name("nexus-0d502811-de24-4e27-b92c-fccb5bf9f798"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5ae62a3-3cee-4a00-a285-de4030662fb7, kind: Service { id: cfce6b5d-973c-4736-93fb-e3347600566b }, name: Name("nexus-cfce6b5d-973c-4736-93fb-e3347600566b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23282024-11-07T02:48:32.700ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23292024-11-07T02:48:32.700ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23302024-11-07T02:48:32.700ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23312024-11-07T02:48:32.700ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23322024-11-07T02:48:32.700ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23332024-11-07T02:48:32.700ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23342024-11-07T02:48:32.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 397 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55402 req_id = 8272a48b-19c1-4a3c-ac0a-74027153c11e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23352024-11-07T02:48:33.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46235
23362024-11-07T02:48:33.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46235 req_id = 4fb26681-d653-4d2f-b46c-97eba05f0b32 response_code = 200 uri = /vpc-routes
23372024-11-07T02:48:33.454ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
23382024-11-07T02:48:33.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46235 req_id = a8f7f90e-03e6-4212-9ae3-3dcbbba16abc response_code = 204 uri = /eip-gateways
23392024-11-07T02:48:33.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46235 req_id = 25017376-cc05-4e38-82a7-1a39ac2d5871 response_code = 204 uri = /vpc-routes
23402024-11-07T02:48:33.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32982
23412024-11-07T02:48:33.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32982 req_id = 943dce0d-7f2e-463a-b5c3-1b0ba43310b9 response_code = 200 uri = /vpc-routes
23422024-11-07T02:48:33.556ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
23432024-11-07T02:48:33.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32982 req_id = 7caecc99-5693-487a-82fe-855592315d6b response_code = 204 uri = /eip-gateways
23442024-11-07T02:48:33.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32982 req_id = 86a87d9e-4e87-42eb-ab13-b9f18ca9ec1e response_code = 204 uri = /vpc-routes
23452024-11-07T02:48:33.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33747
23462024-11-07T02:48:33.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33747 req_id = 1bd08ed9-e042-42c4-abb0-ee0dadaadcb1 response_code = 200 uri = /v2p
23472024-11-07T02:48:33.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37470
23482024-11-07T02:48:33.614ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23492024-11-07T02:48:33.660ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23502024-11-07T02:48:33.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37470 req_id = 0eed35a2-8498-4265-8719-ba95b5b330e8 response_code = 204 uri = /switch-ports
23512024-11-07T02:48:33.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48490
23522024-11-07T02:48:33.731ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23532024-11-07T02:48:33.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37470 req_id = dd95a6cb-0aff-4ddf-b034-0c31a60781fc response_code = 200 uri = /network-bootstore-config
23542024-11-07T02:48:33.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36522
23552024-11-07T02:48:33.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36522 req_id = 8eda810f-d7cd-48ca-8231-967ee112fb16 response_code = 200 uri = /v2p
23562024-11-07T02:48:33.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41577
23572024-11-07T02:48:33.749ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e6dcf98-e56c-4c04-9515-6f635bc8207c, kind: Service { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 }, name: Name("external-dns-81e03cb2-6bdf-4324-a5c8-541c23e034b9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b0270c81-c1ae-4f80-b64a-fc343b0f5d05, kind: Service { id: f2257614-9856-4344-bdd9-897edf2a5e03 }, name: Name("external-dns-f2257614-9856-4344-bdd9-897edf2a5e03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5babe071-e49d-4d68-8a86-a6faf41174c4, kind: Service { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 }, name: Name("nexus-585aaa98-c3b7-4a1f-979c-2088fe719dd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 639dd02e-77b1-44c5-bb10-e9604a99b455, kind: Service { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 }, name: Name("nexus-0d502811-de24-4e27-b92c-fccb5bf9f798"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5ae62a3-3cee-4a00-a285-de4030662fb7, kind: Service { id: cfce6b5d-973c-4736-93fb-e3347600566b }, name: Name("nexus-cfce6b5d-973c-4736-93fb-e3347600566b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23582024-11-07T02:48:33.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23592024-11-07T02:48:33.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23602024-11-07T02:48:33.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23612024-11-07T02:48:33.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23622024-11-07T02:48:33.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23632024-11-07T02:48:33.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23642024-11-07T02:48:33.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 475 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41577 req_id = 52c5f579-8ba0-47a3-80f6-6c01cb233a4c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23652024-11-07T02:48:33.767ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23662024-11-07T02:48:33.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39376
23672024-11-07T02:48:33.806ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e6dcf98-e56c-4c04-9515-6f635bc8207c, kind: Service { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 }, name: Name("external-dns-81e03cb2-6bdf-4324-a5c8-541c23e034b9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b0270c81-c1ae-4f80-b64a-fc343b0f5d05, kind: Service { id: f2257614-9856-4344-bdd9-897edf2a5e03 }, name: Name("external-dns-f2257614-9856-4344-bdd9-897edf2a5e03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5babe071-e49d-4d68-8a86-a6faf41174c4, kind: Service { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 }, name: Name("nexus-585aaa98-c3b7-4a1f-979c-2088fe719dd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 639dd02e-77b1-44c5-bb10-e9604a99b455, kind: Service { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 }, name: Name("nexus-0d502811-de24-4e27-b92c-fccb5bf9f798"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5ae62a3-3cee-4a00-a285-de4030662fb7, kind: Service { id: cfce6b5d-973c-4736-93fb-e3347600566b }, name: Name("nexus-cfce6b5d-973c-4736-93fb-e3347600566b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23682024-11-07T02:48:33.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23692024-11-07T02:48:33.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23702024-11-07T02:48:33.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23712024-11-07T02:48:33.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23722024-11-07T02:48:33.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23732024-11-07T02:48:33.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23742024-11-07T02:48:33.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 555 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39376 req_id = 7d8db0cb-207c-4769-afbe-e0ee3a49c7aa response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23752024-11-07T02:48:33.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94790 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48490 req_id = 99ddb087-4dea-4948-a40d-0edaa5daea7d response_code = 204 uri = /switch-ports
23762024-11-07T02:48:33.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48490 req_id = fc8d1b0a-d1c4-4c83-b7d1-96c5a1dab1bc response_code = 200 uri = /network-bootstore-config
23772024-11-07T02:48:39.518ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62930
23782024-11-07T02:48:39.518ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62930 req_id = 4cc9b1ff-c20b-4030-a597-6d87fcd2cfab response_code = 200 uri = /baseboard
23792024-11-07T02:49:02.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60420
23802024-11-07T02:49:02.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60420 req_id = f5e47e33-52a1-4247-8822-d11b0ae9434f response_code = 200 uri = /v2p
23812024-11-07T02:49:02.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49135
23822024-11-07T02:49:02.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49135 req_id = 9466788e-78cb-4c54-87cf-c715b06b5cc6 response_code = 200 uri = /vpc-routes
23832024-11-07T02:49:02.249ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
23842024-11-07T02:49:02.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49135 req_id = 4c69f930-42e8-4f2f-b5c0-b5b8d7964e78 response_code = 204 uri = /eip-gateways
23852024-11-07T02:49:02.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49135 req_id = c3cdc396-eaf0-44ef-847a-da1423bb9230 response_code = 204 uri = /vpc-routes
23862024-11-07T02:49:02.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43212
23872024-11-07T02:49:02.363ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23882024-11-07T02:49:02.403ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23892024-11-07T02:49:02.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97740 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43212 req_id = 66b452ad-4295-4d09-9634-d507da6e6db5 response_code = 204 uri = /switch-ports
23902024-11-07T02:49:02.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43212 req_id = ede7479b-9b5a-4fc7-95a3-1c0a44e7bce1 response_code = 200 uri = /network-bootstore-config
23912024-11-07T02:49:03.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50135
23922024-11-07T02:49:03.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50135 req_id = bef2e4ef-676f-4621-a5de-bee4ed634263 response_code = 200 uri = /vpc-routes
23932024-11-07T02:49:03.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47245
23942024-11-07T02:49:03.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47245 req_id = ea1d048c-96c3-426b-b18c-dba9d1a6a1a5 response_code = 200 uri = /vpc-routes
23952024-11-07T02:49:03.265ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
23962024-11-07T02:49:03.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50135 req_id = f8ea2d17-6f8f-4049-8b5f-8bc848f123fa response_code = 204 uri = /eip-gateways
23972024-11-07T02:49:03.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50135 req_id = fc5c5994-f8d5-4a55-9bbf-647014cf29e5 response_code = 204 uri = /vpc-routes
23982024-11-07T02:49:03.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
23992024-11-07T02:49:03.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47245 req_id = d02d90e9-01fc-4213-b21a-0b77f2c006dc response_code = 204 uri = /eip-gateways
24002024-11-07T02:49:03.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47245 req_id = 19e8c8a3-489c-47e4-a139-b936196913d7 response_code = 204 uri = /vpc-routes
24012024-11-07T02:49:03.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62938
24022024-11-07T02:49:03.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62938 req_id = 6abac1d2-73c1-4385-a5a2-7750243026d2 response_code = 200 uri = /v2p
24032024-11-07T02:49:03.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41523
24042024-11-07T02:49:03.339ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24052024-11-07T02:49:03.378ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24062024-11-07T02:49:03.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97197 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41523 req_id = f59bdf30-f9fe-43bc-bd9c-993c7ac09a63 response_code = 204 uri = /switch-ports
24072024-11-07T02:49:03.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37656
24082024-11-07T02:49:03.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37656 req_id = c1148320-3bd9-4330-841a-b2ac7ca369f6 response_code = 200 uri = /v2p
24092024-11-07T02:49:03.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41523 req_id = 4231ea0b-b21f-476c-9afd-94aeb328e065 response_code = 200 uri = /network-bootstore-config
24102024-11-07T02:49:03.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33647
24112024-11-07T02:49:03.446ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24122024-11-07T02:49:03.485ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24132024-11-07T02:49:03.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96655 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33647 req_id = 4e8a1659-cf7c-47f0-a48a-875ed8e8239a response_code = 204 uri = /switch-ports
24142024-11-07T02:49:03.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33647 req_id = 46bb49fd-0b81-4cfe-b2f0-d1a13874f0d5 response_code = 200 uri = /network-bootstore-config
24152024-11-07T02:49:09.551ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42278
24162024-11-07T02:49:09.551ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42278 req_id = 050e5468-3c59-46ec-9911-05ad002d2304 response_code = 200 uri = /baseboard
24172024-11-07T02:49:17.709ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24182024-11-07T02:49:17.709ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
24192024-11-07T02:49:17.737ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1972, tv_nsec: 794081292 } time_to_next_cleanup = 599.99999571s
24202024-11-07T02:49:32.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41740
24212024-11-07T02:49:32.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41740 req_id = 1ce201fe-7b78-4aec-a91b-a61dc7feddf2 response_code = 200 uri = /vpc-routes
24222024-11-07T02:49:32.323ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
24232024-11-07T02:49:32.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41740 req_id = ccde3f18-e42b-42da-a4d0-9e344bc7fe7b response_code = 204 uri = /eip-gateways
24242024-11-07T02:49:32.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41740 req_id = b1fd03d0-34d3-4c37-a616-80b3e538284a response_code = 204 uri = /vpc-routes
24252024-11-07T02:49:32.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53183
24262024-11-07T02:49:32.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53183 req_id = 203df8d8-dd45-4bb2-bb31-6985bee5dbf8 response_code = 200 uri = /v2p
24272024-11-07T02:49:32.739ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24282024-11-07T02:49:32.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63083
24292024-11-07T02:49:32.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24302024-11-07T02:49:32.880ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24312024-11-07T02:49:32.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89928 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63083 req_id = 166b3853-c389-4e02-81db-620293a14613 response_code = 204 uri = /switch-ports
24322024-11-07T02:49:32.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63083 req_id = 14fad132-324e-4133-aa08-a4495be16cd0 response_code = 200 uri = /network-bootstore-config
24332024-11-07T02:49:33.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32953
24342024-11-07T02:49:33.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32953 req_id = 03902e5b-a130-4372-9d5d-9913cd1a9e8a response_code = 200 uri = /vpc-routes
24352024-11-07T02:49:33.306ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
24362024-11-07T02:49:33.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32953 req_id = c266d897-3b66-419d-8932-5bce9b220d20 response_code = 204 uri = /eip-gateways
24372024-11-07T02:49:33.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32953 req_id = 42b4c066-b39b-44b5-ba85-71445af01d87 response_code = 204 uri = /vpc-routes
24382024-11-07T02:49:33.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45915
24392024-11-07T02:49:33.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45915 req_id = 9161cf9a-23de-4577-890f-4a8efb43a79b response_code = 200 uri = /v2p
24402024-11-07T02:49:33.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46776
24412024-11-07T02:49:33.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46776 req_id = 88ed61a7-8c1e-4b58-a856-b15e1d8921e1 response_code = 200 uri = /vpc-routes
24422024-11-07T02:49:33.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53858
24432024-11-07T02:49:33.530ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24442024-11-07T02:49:33.566ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24452024-11-07T02:49:33.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53858 req_id = 5a8fb0a8-45bf-4484-afa0-00f6d9e6348e response_code = 204 uri = /switch-ports
24462024-11-07T02:49:33.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59180
24472024-11-07T02:49:33.620ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
24482024-11-07T02:49:33.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46776 req_id = 7ab1afab-ae67-4366-bbe3-1ca5f9f77cb2 response_code = 204 uri = /eip-gateways
24492024-11-07T02:49:33.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53858 req_id = 9e6592e6-07ee-4561-9bb2-90dc8f95db08 response_code = 200 uri = /network-bootstore-config
24502024-11-07T02:49:33.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59180 req_id = 3d78b2f9-380b-4f26-86b9-76064af3a96d response_code = 200 uri = /v2p
24512024-11-07T02:49:33.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46776 req_id = 7be3a28a-2367-48db-badc-1d08e531351e response_code = 204 uri = /vpc-routes
24522024-11-07T02:49:33.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34159
24532024-11-07T02:49:33.662ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24542024-11-07T02:49:33.693ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24552024-11-07T02:49:33.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83865 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34159 req_id = 00214e92-cfdb-45c3-9c09-49b0d600c770 response_code = 204 uri = /switch-ports
24562024-11-07T02:49:33.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34159 req_id = 9f97ba8a-7451-4385-a229-7f27191e9ac1 response_code = 200 uri = /network-bootstore-config
24572024-11-07T02:49:39.585ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40390
24582024-11-07T02:49:39.585ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40390 req_id = d2110d91-81d9-4b0e-959a-2b0a5868354d response_code = 200 uri = /baseboard
24592024-11-07T02:50:02.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54984
24602024-11-07T02:50:02.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54984 req_id = ee8a1071-a34f-464d-a30d-0bc286b0076d response_code = 200 uri = /vpc-routes
24612024-11-07T02:50:02.242ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
24622024-11-07T02:50:02.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54984 req_id = e48a24ef-e3ef-45a9-9d22-f2d7a29e8429 response_code = 204 uri = /eip-gateways
24632024-11-07T02:50:02.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52820
24642024-11-07T02:50:02.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52820 req_id = 7dbe4702-e79b-4bea-bbd1-5d9f8e9598a6 response_code = 200 uri = /v2p
24652024-11-07T02:50:02.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54984 req_id = 22574928-ebb3-4540-93f5-49d93100d56d response_code = 204 uri = /vpc-routes
24662024-11-07T02:50:02.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43185
24672024-11-07T02:50:02.312ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24682024-11-07T02:50:02.350ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24692024-11-07T02:50:02.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96613 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43185 req_id = aba8cc11-a7d3-48bb-a186-14de94e5d606 response_code = 204 uri = /switch-ports
24702024-11-07T02:50:02.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43185 req_id = a5496896-7cf4-44a9-857f-23cb2114c805 response_code = 200 uri = /network-bootstore-config
24712024-11-07T02:50:03.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35950
24722024-11-07T02:50:03.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35950 req_id = d038ef36-2c56-4545-b39a-3c06f2eedffb response_code = 200 uri = /vpc-routes
24732024-11-07T02:50:03.236ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
24742024-11-07T02:50:03.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35950 req_id = 02e8c17b-3785-4876-a76a-34bbc2d1d010 response_code = 204 uri = /eip-gateways
24752024-11-07T02:50:03.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35950 req_id = 257c44b9-7ae3-4873-adb5-e7aa7e710ac5 response_code = 204 uri = /vpc-routes
24762024-11-07T02:50:03.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38891
24772024-11-07T02:50:03.270ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24782024-11-07T02:50:03.312ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24792024-11-07T02:50:03.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104727 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38891 req_id = 429492a9-aa47-4564-bf3a-17ba09de8f79 response_code = 204 uri = /switch-ports
24802024-11-07T02:50:03.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61159
24812024-11-07T02:50:03.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56002
24822024-11-07T02:50:03.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56002 req_id = cf12ba5f-30d2-4090-a550-eac828695c7a response_code = 200 uri = /v2p
24832024-11-07T02:50:03.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38891 req_id = a634b680-b880-4335-8b5b-02af2777a1a5 response_code = 200 uri = /network-bootstore-config
24842024-11-07T02:50:03.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61159 req_id = ce52a3cf-f4a6-4706-8c41-bcf7144d1474 response_code = 200 uri = /vpc-routes
24852024-11-07T02:50:03.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56393
24862024-11-07T02:50:03.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56393 req_id = 89144e27-5b7a-4638-bf8a-49cc59433a83 response_code = 200 uri = /v2p
24872024-11-07T02:50:03.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39546
24882024-11-07T02:50:03.420ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24892024-11-07T02:50:03.457ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24902024-11-07T02:50:03.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98511 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39546 req_id = 9ae99956-fcaf-4133-bd0f-d5881bc14b75 response_code = 204 uri = /switch-ports
24912024-11-07T02:50:03.519ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
24922024-11-07T02:50:03.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61159 req_id = a5081396-7242-4d7d-a83f-58337a10bef8 response_code = 204 uri = /eip-gateways
24932024-11-07T02:50:03.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39546 req_id = 2f5d3a97-daba-4237-8123-dc3b9996fe47 response_code = 200 uri = /network-bootstore-config
24942024-11-07T02:50:03.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61159 req_id = c85fdf07-62a8-459a-8fd4-5a6261033106 response_code = 204 uri = /vpc-routes
24952024-11-07T02:50:09.618ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62592
24962024-11-07T02:50:09.618ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62592 req_id = 889409eb-9b3f-4f00-bc77-64413696f3fb response_code = 200 uri = /baseboard
24972024-11-07T02:50:32.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63536
24982024-11-07T02:50:32.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63536 req_id = 749f9ad2-b99a-487c-850d-f4bafa1d3f72 response_code = 200 uri = /vpc-routes
24992024-11-07T02:50:32.372ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
25002024-11-07T02:50:32.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63536 req_id = 0716c77e-ff40-4574-a179-c209093be31b response_code = 204 uri = /eip-gateways
25012024-11-07T02:50:32.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33769
25022024-11-07T02:50:32.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33769 req_id = 099f021d-c928-4897-90bf-64b47929d17d response_code = 200 uri = /v2p
25032024-11-07T02:50:32.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63536 req_id = 8583306e-6a89-46eb-8aa5-0190f4a9a2be response_code = 204 uri = /vpc-routes
25042024-11-07T02:50:32.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33900
25052024-11-07T02:50:32.530ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25062024-11-07T02:50:32.572ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25072024-11-07T02:50:32.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100544 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33900 req_id = b5bbfb94-71f2-4899-abfe-252e33aaa4f4 response_code = 204 uri = /switch-ports
25082024-11-07T02:50:32.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33900 req_id = cb736dd1-caab-4d51-92b1-261fc6fba160 response_code = 200 uri = /network-bootstore-config
25092024-11-07T02:50:33.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39803
25102024-11-07T02:50:33.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39803 req_id = 9276c5e4-0edd-4a0a-afac-051665bbff6f response_code = 200 uri = /vpc-routes
25112024-11-07T02:50:33.263ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
25122024-11-07T02:50:33.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39803 req_id = 67de9c33-cba6-4742-8fab-0f7ec74dc4e9 response_code = 204 uri = /eip-gateways
25132024-11-07T02:50:33.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39803 req_id = 1bdc3bb8-77e2-4332-87da-30e4f5bef8ab response_code = 204 uri = /vpc-routes
25142024-11-07T02:50:33.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43768
25152024-11-07T02:50:33.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43768 req_id = 40c74bee-d8da-4b1f-9304-7f873ee79ee8 response_code = 200 uri = /vpc-routes
25162024-11-07T02:50:33.396ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
25172024-11-07T02:50:33.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43768 req_id = 5f262b10-b3d8-4d49-924e-4ecc292170ad response_code = 204 uri = /eip-gateways
25182024-11-07T02:50:33.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43768 req_id = 90a228b6-bdf9-4ab4-ac5a-a717f41522af response_code = 204 uri = /vpc-routes
25192024-11-07T02:50:33.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56397
25202024-11-07T02:50:33.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56397 req_id = 1c9404d6-dcca-43ee-ba7c-4ba2e3d8ebe8 response_code = 200 uri = /v2p
25212024-11-07T02:50:33.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41576
25222024-11-07T02:50:33.461ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25232024-11-07T02:50:33.500ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25242024-11-07T02:50:33.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103057 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41576 req_id = c63b4bac-c8e0-42cd-9d98-4792d7435de1 response_code = 204 uri = /switch-ports
25252024-11-07T02:50:33.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53644
25262024-11-07T02:50:33.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51732
25272024-11-07T02:50:33.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53644 req_id = 4f032b28-89d5-4431-8ffe-80546bf677fb response_code = 200 uri = /v2p
25282024-11-07T02:50:33.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41576 req_id = ebd5ff5f-f50b-4d82-8edc-d01707c40910 response_code = 200 uri = /network-bootstore-config
25292024-11-07T02:50:33.565ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25302024-11-07T02:50:33.604ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25312024-11-07T02:50:33.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95276 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51732 req_id = 6310eae2-7d9c-4633-9eff-dbeee105d2b5 response_code = 204 uri = /switch-ports
25322024-11-07T02:50:33.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51732 req_id = 8a1546a0-2a7a-4dd5-a0f0-ae2c561926ed response_code = 200 uri = /network-bootstore-config
25332024-11-07T02:50:39.651ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62245
25342024-11-07T02:50:39.651ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62245 req_id = 2d8f8071-9439-4ecc-9d15-935c0793307c response_code = 200 uri = /baseboard
25352024-11-07T02:51:02.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61958
25362024-11-07T02:51:02.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61958 req_id = fa39095f-1cfb-46a5-9b24-a7301092f521 response_code = 200 uri = /vpc-routes
25372024-11-07T02:51:02.371ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
25382024-11-07T02:51:02.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61958 req_id = 6298b8e3-0205-4437-b23d-8844138c9ff3 response_code = 204 uri = /eip-gateways
25392024-11-07T02:51:02.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39333
25402024-11-07T02:51:02.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39333 req_id = a0c424c4-63b7-4891-b81b-bb4dbd6ba811 response_code = 200 uri = /v2p
25412024-11-07T02:51:02.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61958 req_id = 8a219cf7-d676-42d4-b3f9-a968195ba599 response_code = 204 uri = /vpc-routes
25422024-11-07T02:51:02.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52988
25432024-11-07T02:51:02.470ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25442024-11-07T02:51:02.512ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25452024-11-07T02:51:02.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100672 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52988 req_id = e82bc98f-e48b-4f45-ae92-b3f6d8dd443b response_code = 204 uri = /switch-ports
25462024-11-07T02:51:02.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52988 req_id = 537dfce0-72a5-4006-9dfb-79ee6a1842db response_code = 200 uri = /network-bootstore-config
25472024-11-07T02:51:03.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37114
25482024-11-07T02:51:03.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37114 req_id = 5edfb3ca-fce9-4a38-80af-9d8e834dcf89 response_code = 200 uri = /vpc-routes
25492024-11-07T02:51:03.183ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
25502024-11-07T02:51:03.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37114 req_id = 6480416b-77d1-4908-bd2f-a3aa22d652b0 response_code = 204 uri = /eip-gateways
25512024-11-07T02:51:03.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61988
25522024-11-07T02:51:03.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61988 req_id = 2530e33c-b4f8-403c-b087-c38ed46eaaf9 response_code = 200 uri = /v2p
25532024-11-07T02:51:03.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37114 req_id = c5de1998-93fe-47b6-abca-076465c6e52b response_code = 204 uri = /vpc-routes
25542024-11-07T02:51:03.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52844
25552024-11-07T02:51:03.261ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25562024-11-07T02:51:03.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25572024-11-07T02:51:03.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102069 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52844 req_id = dd105ba2-379a-48ea-ab99-7fa7daab6d78 response_code = 204 uri = /switch-ports
25582024-11-07T02:51:03.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60412
25592024-11-07T02:51:03.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60412 req_id = 8e529917-d711-461d-b886-362408a77387 response_code = 200 uri = /vpc-routes
25602024-11-07T02:51:03.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52844 req_id = e7c1a820-1bf7-4291-a987-28306e55d816 response_code = 200 uri = /network-bootstore-config
25612024-11-07T02:51:03.409ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
25622024-11-07T02:51:03.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60412 req_id = f1cf9aaf-ec75-437a-b308-d833c4b5d0e8 response_code = 204 uri = /eip-gateways
25632024-11-07T02:51:03.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60412 req_id = b4ec4bf9-bbaf-4de9-9364-71e763296abf response_code = 204 uri = /vpc-routes
25642024-11-07T02:51:03.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55778
25652024-11-07T02:51:03.445ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25662024-11-07T02:51:03.487ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25672024-11-07T02:51:03.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98872 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55778 req_id = 2e393917-56c0-48f4-bb77-fc78cc3ebd09 response_code = 204 uri = /switch-ports
25682024-11-07T02:51:03.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50233
25692024-11-07T02:51:03.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50233 req_id = 2abd5335-5d2c-4f65-9567-2a527e159aff response_code = 200 uri = /v2p
25702024-11-07T02:51:03.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55778 req_id = c121a343-0d74-4ac4-9fee-4ec16e6d6420 response_code = 200 uri = /network-bootstore-config
25712024-11-07T02:51:09.686ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48654
25722024-11-07T02:51:09.686ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48654 req_id = f33437a4-68e2-43bf-b03b-cb6d10cc443a response_code = 200 uri = /baseboard
25732024-11-07T02:51:19.304ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
25742024-11-07T02:51:19.305ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
25752024-11-07T02:51:29.305ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
25762024-11-07T02:51:29.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
25772024-11-07T02:51:29.308ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
25782024-11-07T02:51:29.309ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
25792024-11-07T02:51:32.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41796
25802024-11-07T02:51:32.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41796 req_id = f883f7ed-16cd-47b3-9ac5-9c27a5221459 response_code = 200 uri = /vpc-routes
25812024-11-07T02:51:32.393ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
25822024-11-07T02:51:32.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41796 req_id = c2fc4d0f-84bb-42a0-9083-58d0118c8498 response_code = 204 uri = /eip-gateways
25832024-11-07T02:51:32.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41796 req_id = 95774246-869d-4db7-9ba5-4ae740f87ca7 response_code = 204 uri = /vpc-routes
25842024-11-07T02:51:32.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32795
25852024-11-07T02:51:32.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32795 req_id = db5147aa-8631-4822-a832-534b045530c6 response_code = 200 uri = /v2p
25862024-11-07T02:51:32.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38532
25872024-11-07T02:51:32.606ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25882024-11-07T02:51:32.647ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25892024-11-07T02:51:32.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104221 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38532 req_id = 18fdfc62-c47f-4b22-bf4a-8805920eb1f9 response_code = 204 uri = /switch-ports
25902024-11-07T02:51:32.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38532 req_id = a173e3a8-6aa2-4bb6-bae0-c43e784dd699 response_code = 200 uri = /network-bootstore-config
25912024-11-07T02:51:33.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33907
25922024-11-07T02:51:33.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33907 req_id = 39ec94cf-197d-44e9-848e-ade3a665bcdf response_code = 200 uri = /vpc-routes
25932024-11-07T02:51:33.360ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
25942024-11-07T02:51:33.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33907 req_id = 39d369d3-6845-401a-9f95-3a4403884ca6 response_code = 204 uri = /eip-gateways
25952024-11-07T02:51:33.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33907 req_id = 48de0a4b-4bd3-4dbe-b11c-0553d485037d response_code = 204 uri = /vpc-routes
25962024-11-07T02:51:33.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36579
25972024-11-07T02:51:33.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36579 req_id = 96c27826-c22d-49f4-a612-58b7df5650a6 response_code = 200 uri = /vpc-routes
25982024-11-07T02:51:33.492ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
25992024-11-07T02:51:33.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36579 req_id = 8f144468-7c0f-4b9a-afcc-ab27db1d7e54 response_code = 204 uri = /eip-gateways
26002024-11-07T02:51:33.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50019
26012024-11-07T02:51:33.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50019 req_id = c9f1519b-6b13-4667-8ee6-8170fbbaa76a response_code = 200 uri = /v2p
26022024-11-07T02:51:33.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36579 req_id = 29e2cb36-7af5-471a-a7c0-814f18a57ef6 response_code = 204 uri = /vpc-routes
26032024-11-07T02:51:33.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51579
26042024-11-07T02:51:33.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51579 req_id = b316cea9-3d2a-4411-9d33-26f4fcd367ee response_code = 200 uri = /v2p
26052024-11-07T02:51:33.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42178
26062024-11-07T02:51:33.614ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
26072024-11-07T02:51:33.655ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
26082024-11-07T02:51:33.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101155 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42178 req_id = 8a8eed4e-856e-4b3f-b3e9-70a7a1296819 response_code = 204 uri = /switch-ports
26092024-11-07T02:51:33.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63572
26102024-11-07T02:51:33.715ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
26112024-11-07T02:51:33.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42178 req_id = d2e38287-e225-429c-96e2-83542695d045 response_code = 200 uri = /network-bootstore-config
26122024-11-07T02:51:33.757ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
26132024-11-07T02:51:33.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99740 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63572 req_id = a9007689-5541-4668-a48d-6fd814654c40 response_code = 204 uri = /switch-ports
26142024-11-07T02:51:33.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63572 req_id = 4051cf5e-2b90-4262-b5de-e50ff485fd04 response_code = 200 uri = /network-bootstore-config
26152024-11-07T02:51:39.309ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26162024-11-07T02:51:39.311ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26172024-11-07T02:51:39.314ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26182024-11-07T02:51:39.314ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26192024-11-07T02:51:39.721ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53211
26202024-11-07T02:51:39.721ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53211 req_id = cd959654-b34e-42e8-8391-abbe8c1ea7d7 response_code = 200 uri = /baseboard
26212024-11-07T02:51:49.312ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26222024-11-07T02:51:49.313ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26232024-11-07T02:51:49.316ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26242024-11-07T02:51:49.316ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26252024-11-07T02:51:59.315ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26262024-11-07T02:51:59.316ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26272024-11-07T02:51:59.319ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26282024-11-07T02:51:59.320ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26292024-11-07T02:52:02.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46527
26302024-11-07T02:52:02.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46527 req_id = 3c593859-b5e1-42ff-9a1f-10beb10284ea response_code = 200 uri = /vpc-routes
26312024-11-07T02:52:02.167ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
26322024-11-07T02:52:02.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46527 req_id = c3ebdf75-f766-417c-9d2c-b02c00daa8b9 response_code = 204 uri = /eip-gateways
26332024-11-07T02:52:02.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53065
26342024-11-07T02:52:02.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53065 req_id = 6ea3dd83-5a2e-48c0-9388-e39865393999 response_code = 200 uri = /v2p
26352024-11-07T02:52:02.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46527 req_id = edf9401e-a034-45fe-8424-9d11ace9ee4a response_code = 204 uri = /vpc-routes
26362024-11-07T02:52:02.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64920
26372024-11-07T02:52:02.364ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
26382024-11-07T02:52:02.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
26392024-11-07T02:52:02.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97482 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64920 req_id = 21038547-3628-488b-ab8d-9a18c9eb6444 response_code = 204 uri = /switch-ports
26402024-11-07T02:52:02.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64920 req_id = c5278af4-12db-415d-8679-3ab9ad050b8d response_code = 200 uri = /network-bootstore-config
26412024-11-07T02:52:03.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43977
26422024-11-07T02:52:03.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43977 req_id = 221ed64b-1e0b-49ce-87c7-c2a6ebcba48c response_code = 200 uri = /vpc-routes
26432024-11-07T02:52:03.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
26442024-11-07T02:52:03.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43977 req_id = f80a5bcd-211f-4499-b3e6-2ceecafb9d87 response_code = 204 uri = /eip-gateways
26452024-11-07T02:52:03.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43977 req_id = dbdf99a7-7e59-492c-bdab-cf8d8f30fab2 response_code = 204 uri = /vpc-routes
26462024-11-07T02:52:03.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61064
26472024-11-07T02:52:03.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61064 req_id = 7c9dab5b-c0b6-43c6-96ee-b0d6eddb58fe response_code = 200 uri = /v2p
26482024-11-07T02:52:03.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47099
26492024-11-07T02:52:03.256ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
26502024-11-07T02:52:03.296ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
26512024-11-07T02:52:03.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95913 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47099 req_id = 742137f5-7b57-417b-93d0-4f4554bd27f1 response_code = 204 uri = /switch-ports
26522024-11-07T02:52:03.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54798
26532024-11-07T02:52:03.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54798 req_id = dd2bc43b-e441-4e4d-90fc-32300c36b38d response_code = 200 uri = /vpc-routes
26542024-11-07T02:52:03.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47099 req_id = f6d4df3d-7eb7-4f53-bd49-e604db3f9e69 response_code = 200 uri = /network-bootstore-config
26552024-11-07T02:52:03.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36043
26562024-11-07T02:52:03.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36043 req_id = 344faba9-3e40-460d-bdcb-f8ca3f8a1784 response_code = 200 uri = /v2p
26572024-11-07T02:52:03.393ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
26582024-11-07T02:52:03.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54798 req_id = 5d282bf4-6637-4b23-9bd3-ecf705cb5a3f response_code = 204 uri = /eip-gateways
26592024-11-07T02:52:03.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54798 req_id = a21c7408-a3d6-4bd5-bfab-6112cb694d85 response_code = 204 uri = /vpc-routes
26602024-11-07T02:52:03.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41654
26612024-11-07T02:52:03.436ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
26622024-11-07T02:52:03.474ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
26632024-11-07T02:52:03.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94184 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41654 req_id = 333943c3-c528-488f-8dd6-65bed6761bc4 response_code = 204 uri = /switch-ports
26642024-11-07T02:52:03.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41654 req_id = e8fbaad0-8a88-481d-86a9-354e3991969b response_code = 200 uri = /network-bootstore-config
26652024-11-07T02:52:09.318ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26662024-11-07T02:52:09.319ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26672024-11-07T02:52:09.322ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26682024-11-07T02:52:09.322ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26692024-11-07T02:52:09.754ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40443
26702024-11-07T02:52:09.754ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40443 req_id = 3af8d8c9-6ef3-42ca-87f4-1bf8709ea303 response_code = 200 uri = /baseboard
26712024-11-07T02:52:19.320ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26722024-11-07T02:52:19.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26732024-11-07T02:52:19.324ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26742024-11-07T02:52:19.324ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26752024-11-07T02:52:29.325ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26762024-11-07T02:52:29.325ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26772024-11-07T02:52:29.328ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26782024-11-07T02:52:29.329ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
26792024-11-07T02:52:32.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43319
26802024-11-07T02:52:32.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43319 req_id = d65a9757-88e3-4b4c-ba95-46a394b9ce99 response_code = 200 uri = /v2p
26812024-11-07T02:52:32.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36563
26822024-11-07T02:52:32.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36563 req_id = 386cc520-32d0-46d7-9213-bb3937abdd62 response_code = 200 uri = /vpc-routes
26832024-11-07T02:52:32.359ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
26842024-11-07T02:52:32.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36563 req_id = 32744aa1-b2eb-49f5-9348-1a2717139a1a response_code = 204 uri = /eip-gateways
26852024-11-07T02:52:32.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36563 req_id = 716eca38-4f0b-4346-82ba-fdf961d6020f response_code = 204 uri = /vpc-routes
26862024-11-07T02:52:32.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63329
26872024-11-07T02:52:32.572ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
26882024-11-07T02:52:32.612ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
26892024-11-07T02:52:32.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63329 req_id = e08a0d7b-f3b8-40b1-abfc-3f01b819d8b6 response_code = 204 uri = /switch-ports
26902024-11-07T02:52:32.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63329 req_id = 88b473b1-1844-4eb2-8f37-995aca2defa1 response_code = 200 uri = /network-bootstore-config
26912024-11-07T02:52:33.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54047
26922024-11-07T02:52:33.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54047 req_id = d11871c5-f855-466b-9ba2-57962d67fd98 response_code = 200 uri = /vpc-routes
26932024-11-07T02:52:33.288ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
26942024-11-07T02:52:33.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54047 req_id = d2b23609-cd01-49b1-847b-a01700d9ef31 response_code = 204 uri = /eip-gateways
26952024-11-07T02:52:33.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54047 req_id = 8a036f36-d835-459a-96f4-d5fbae678408 response_code = 204 uri = /vpc-routes
26962024-11-07T02:52:33.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44270
26972024-11-07T02:52:33.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44270 req_id = ca08693f-c1d2-4e43-b46f-146a2af7d748 response_code = 200 uri = /vpc-routes
26982024-11-07T02:52:33.469ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
26992024-11-07T02:52:33.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44270 req_id = 72e94687-421a-4958-a27d-76e40274b700 response_code = 204 uri = /eip-gateways
27002024-11-07T02:52:33.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44270 req_id = 8d759428-54a2-4da4-9681-1618f5ab29f8 response_code = 204 uri = /vpc-routes
27012024-11-07T02:52:33.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43549
27022024-11-07T02:52:33.532ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
27032024-11-07T02:52:33.575ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
27042024-11-07T02:52:33.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43549 req_id = e616afa2-a167-4738-a1f0-35dd063c6f95 response_code = 204 uri = /switch-ports
27052024-11-07T02:52:33.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41559
27062024-11-07T02:52:33.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60383
27072024-11-07T02:52:33.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58102
27082024-11-07T02:52:33.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43549 req_id = 232194f6-0edb-4c80-862a-c10bb38c72ad response_code = 200 uri = /network-bootstore-config
27092024-11-07T02:52:33.631ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
27102024-11-07T02:52:33.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41559 req_id = 78e66422-08d3-4ad1-a6d5-a48d365d8de1 response_code = 200 uri = /v2p
27112024-11-07T02:52:33.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5941 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58102 req_id = e54289c4-da94-4204-8b31-66b33900b99f response_code = 200 uri = /v2p
27122024-11-07T02:52:33.669ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
27132024-11-07T02:52:33.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94702 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60383 req_id = 1e4b11e8-c9ac-4b63-bf5a-0c8ae7b605fe response_code = 204 uri = /switch-ports
27142024-11-07T02:52:33.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60383 req_id = 3edba918-5c8a-4107-a15c-fc53e5558225 response_code = 200 uri = /network-bootstore-config
27152024-11-07T02:52:39.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27162024-11-07T02:52:39.337ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27172024-11-07T02:52:39.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27182024-11-07T02:52:39.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27192024-11-07T02:52:39.789ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41769
27202024-11-07T02:52:39.789ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41769 req_id = 1a3e7755-f23a-41e6-97aa-15e64d370cfb response_code = 200 uri = /baseboard
27212024-11-07T02:52:49.338ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27222024-11-07T02:52:49.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27232024-11-07T02:52:49.342ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27242024-11-07T02:52:49.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27252024-11-07T02:52:59.340ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27262024-11-07T02:52:59.341ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27272024-11-07T02:52:59.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27282024-11-07T02:52:59.345ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27292024-11-07T02:53:02.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56766
27302024-11-07T02:53:02.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56766 req_id = 8147e2be-07d7-47ed-bc47-d866dd75be14 response_code = 200 uri = /vpc-routes
27312024-11-07T02:53:02.178ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
27322024-11-07T02:53:02.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56766 req_id = adc6f121-aab3-43a5-8241-f9906e79a3d1 response_code = 204 uri = /eip-gateways
27332024-11-07T02:53:02.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56766 req_id = b32c290b-45bb-4fb6-8e27-7d533e2b21fa response_code = 204 uri = /vpc-routes
27342024-11-07T02:53:02.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53468
27352024-11-07T02:53:02.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53468 req_id = 07a0cc46-f595-4e8c-9ddb-83df55a63cd0 response_code = 200 uri = /v2p
27362024-11-07T02:53:02.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60702
27372024-11-07T02:53:02.395ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
27382024-11-07T02:53:02.438ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
27392024-11-07T02:53:02.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60702 req_id = f9fd1025-eaad-456b-aa4d-5b52e354a4cc response_code = 204 uri = /switch-ports
27402024-11-07T02:53:02.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60702 req_id = 18f248e1-484e-4aca-84d1-ef8edd4020e3 response_code = 200 uri = /network-bootstore-config
27412024-11-07T02:53:03.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35944
27422024-11-07T02:53:03.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35944 req_id = fa23d584-3761-418a-9a70-dc851e71b4b5 response_code = 200 uri = /vpc-routes
27432024-11-07T02:53:03.151ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
27442024-11-07T02:53:03.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35944 req_id = ab9d5a1c-6efa-4029-a46c-fbfcd2678325 response_code = 204 uri = /eip-gateways
27452024-11-07T02:53:03.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35944 req_id = bfbcbb00-6ca9-4f89-b299-52d1066a5d87 response_code = 204 uri = /vpc-routes
27462024-11-07T02:53:03.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44306
27472024-11-07T02:53:03.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44306 req_id = f8daaa27-2372-4eeb-8616-136747399bc8 response_code = 200 uri = /v2p
27482024-11-07T02:53:03.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37401
27492024-11-07T02:53:03.239ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
27502024-11-07T02:53:03.288ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
27512024-11-07T02:53:03.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37401 req_id = 7dc61bcf-ba2b-47a4-afdc-729985205e9f response_code = 204 uri = /switch-ports
27522024-11-07T02:53:03.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60973
27532024-11-07T02:53:03.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55029
27542024-11-07T02:53:03.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55029 req_id = 8d86bee1-c41e-4cb1-b294-b89fd8bcb176 response_code = 200 uri = /v2p
27552024-11-07T02:53:03.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60973 req_id = cfa1bd31-85d4-4d6f-806d-d68c494c90a1 response_code = 200 uri = /vpc-routes
27562024-11-07T02:53:03.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37401 req_id = 75343788-8252-4322-9c79-626c34484892 response_code = 200 uri = /network-bootstore-config
27572024-11-07T02:53:03.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64631
27582024-11-07T02:53:03.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
27592024-11-07T02:53:03.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
27602024-11-07T02:53:03.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95342 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64631 req_id = a2a04aa3-f274-4c0e-b167-d578b43c4025 response_code = 204 uri = /switch-ports
27612024-11-07T02:53:03.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64631 req_id = 2c5a836b-0e28-40c8-b411-f9cdad1a0c3e response_code = 200 uri = /network-bootstore-config
27622024-11-07T02:53:03.463ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
27632024-11-07T02:53:03.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60973 req_id = 95ca36b9-7717-4e6a-8094-538e04b52a06 response_code = 204 uri = /eip-gateways
27642024-11-07T02:53:03.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60973 req_id = 8093344b-f7f5-4ad0-9944-cb18a5b1efc0 response_code = 204 uri = /vpc-routes
27652024-11-07T02:53:09.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27662024-11-07T02:53:09.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27672024-11-07T02:53:09.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27682024-11-07T02:53:09.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27692024-11-07T02:53:09.821ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53990
27702024-11-07T02:53:09.822ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53990 req_id = 67135a83-8e99-400f-a507-32a6c34a460a response_code = 200 uri = /baseboard
27712024-11-07T02:53:19.345ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27722024-11-07T02:53:19.346ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27732024-11-07T02:53:19.348ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27742024-11-07T02:53:19.349ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27752024-11-07T02:53:29.349ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27762024-11-07T02:53:29.350ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27772024-11-07T02:53:29.352ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27782024-11-07T02:53:29.353ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
27792024-11-07T02:53:32.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51922
27802024-11-07T02:53:32.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51922 req_id = 7a733b6e-5af9-4548-a383-ff9b2654c7ff response_code = 200 uri = /vpc-routes
27812024-11-07T02:53:32.498ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
27822024-11-07T02:53:32.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51922 req_id = 72a71037-651e-4ea7-9113-fd2460afd4fe response_code = 204 uri = /eip-gateways
27832024-11-07T02:53:32.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51922 req_id = 20949aa9-528b-4bf0-b918-72d874dfcffe response_code = 204 uri = /vpc-routes
27842024-11-07T02:53:32.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58025
27852024-11-07T02:53:32.547ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
27862024-11-07T02:53:32.590ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
27872024-11-07T02:53:32.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107148 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58025 req_id = a26de496-c496-4c19-a2de-e9ef500ad58a response_code = 204 uri = /switch-ports
27882024-11-07T02:53:32.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43062
27892024-11-07T02:53:32.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58025 req_id = 7d5b43bb-cfd0-430f-8013-1c8521a7af1a response_code = 200 uri = /network-bootstore-config
27902024-11-07T02:53:32.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43062 req_id = ea2281a9-25c6-465b-9014-da50f239232c response_code = 200 uri = /v2p
27912024-11-07T02:53:32.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62860
27922024-11-07T02:53:32.753ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e6dcf98-e56c-4c04-9515-6f635bc8207c, kind: Service { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 }, name: Name("external-dns-81e03cb2-6bdf-4324-a5c8-541c23e034b9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b0270c81-c1ae-4f80-b64a-fc343b0f5d05, kind: Service { id: f2257614-9856-4344-bdd9-897edf2a5e03 }, name: Name("external-dns-f2257614-9856-4344-bdd9-897edf2a5e03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5babe071-e49d-4d68-8a86-a6faf41174c4, kind: Service { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 }, name: Name("nexus-585aaa98-c3b7-4a1f-979c-2088fe719dd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 639dd02e-77b1-44c5-bb10-e9604a99b455, kind: Service { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 }, name: Name("nexus-0d502811-de24-4e27-b92c-fccb5bf9f798"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5ae62a3-3cee-4a00-a285-de4030662fb7, kind: Service { id: cfce6b5d-973c-4736-93fb-e3347600566b }, name: Name("nexus-cfce6b5d-973c-4736-93fb-e3347600566b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27932024-11-07T02:53:32.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27942024-11-07T02:53:32.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27952024-11-07T02:53:32.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27962024-11-07T02:53:32.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27972024-11-07T02:53:32.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27982024-11-07T02:53:32.753ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27992024-11-07T02:53:32.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62860 req_id = cef93411-def2-4991-b376-21e0c787f2db response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28002024-11-07T02:53:33.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52794
28012024-11-07T02:53:33.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52794 req_id = 9858960c-08b4-4bad-887c-f3b801efc707 response_code = 200 uri = /vpc-routes
28022024-11-07T02:53:33.321ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
28032024-11-07T02:53:33.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52794 req_id = cd696df6-921c-499e-abf3-578b6d7170cc response_code = 204 uri = /eip-gateways
28042024-11-07T02:53:33.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52794 req_id = 44c88fba-b053-46ac-975d-e1fadb07bfee response_code = 204 uri = /vpc-routes
28052024-11-07T02:53:33.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64978
28062024-11-07T02:53:33.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
28072024-11-07T02:53:33.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
28082024-11-07T02:53:33.340ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:177
28092024-11-07T02:53:33.341ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:177
28102024-11-07T02:53:33.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54605
28112024-11-07T02:53:33.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54605 req_id = 241997b5-992f-4e63-b8d5-b4fa8dd14c15 response_code = 200 uri = /vpc-routes
28122024-11-07T02:53:33.489ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
28132024-11-07T02:53:33.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54605 req_id = 614f1d52-aaad-48a2-921d-d6e95ae78a46 response_code = 204 uri = /eip-gateways
28142024-11-07T02:53:33.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 990 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54605 req_id = b261e9a7-3531-455c-aada-e3387a3a1908 response_code = 204 uri = /vpc-routes
28152024-11-07T02:53:33.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50768
28162024-11-07T02:53:33.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50768 req_id = c0d4d81e-fec2-4e36-beb2-885b878724ae response_code = 200 uri = /v2p
28172024-11-07T02:53:33.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61324
28182024-11-07T02:53:33.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34131
28192024-11-07T02:53:33.602ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
28202024-11-07T02:53:33.602ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
28212024-11-07T02:53:33.602ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:177
28222024-11-07T02:53:33.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61324 req_id = 3688d7be-9322-4887-86a0-10cde1c6bf63 response_code = 200 uri = /v2p
28232024-11-07T02:53:33.603ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:177
28242024-11-07T02:53:33.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 284515 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64978 req_id = 06f55000-95e5-4148-9bde-6b283b7e8292 response_code = 200 uri = /inventory
28252024-11-07T02:53:33.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40893
28262024-11-07T02:53:33.669ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e6dcf98-e56c-4c04-9515-6f635bc8207c, kind: Service { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 }, name: Name("external-dns-81e03cb2-6bdf-4324-a5c8-541c23e034b9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b0270c81-c1ae-4f80-b64a-fc343b0f5d05, kind: Service { id: f2257614-9856-4344-bdd9-897edf2a5e03 }, name: Name("external-dns-f2257614-9856-4344-bdd9-897edf2a5e03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5babe071-e49d-4d68-8a86-a6faf41174c4, kind: Service { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 }, name: Name("nexus-585aaa98-c3b7-4a1f-979c-2088fe719dd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 639dd02e-77b1-44c5-bb10-e9604a99b455, kind: Service { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 }, name: Name("nexus-0d502811-de24-4e27-b92c-fccb5bf9f798"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5ae62a3-3cee-4a00-a285-de4030662fb7, kind: Service { id: cfce6b5d-973c-4736-93fb-e3347600566b }, name: Name("nexus-cfce6b5d-973c-4736-93fb-e3347600566b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28272024-11-07T02:53:33.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28282024-11-07T02:53:33.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28292024-11-07T02:53:33.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28302024-11-07T02:53:33.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28312024-11-07T02:53:33.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28322024-11-07T02:53:33.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28332024-11-07T02:53:33.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 462 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40893 req_id = 06074afb-57b2-463b-8644-fbf5b98d40d5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28342024-11-07T02:53:33.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40124
28352024-11-07T02:53:33.682ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
28362024-11-07T02:53:33.727ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
28372024-11-07T02:53:33.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118255 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40124 req_id = e7e15a66-0995-499d-b26b-2964f5d5fc8b response_code = 204 uri = /switch-ports
28382024-11-07T02:53:33.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40124 req_id = 8c2b9958-b472-43c2-951e-a5bd1ee88c8c response_code = 200 uri = /network-bootstore-config
28392024-11-07T02:53:33.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36790
28402024-11-07T02:53:33.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
28412024-11-07T02:53:33.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
28422024-11-07T02:53:33.810ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/config/omicron-zones.json file = common/src/ledger.rs:177
28432024-11-07T02:53:33.811ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/config/omicron-zones.json file = common/src/ledger.rs:177
28442024-11-07T02:53:33.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48793
28452024-11-07T02:53:33.837ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
28462024-11-07T02:53:33.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 276469 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34131 req_id = 95ecb02e-3762-49fe-a2ea-22653cb58992 response_code = 200 uri = /inventory
28472024-11-07T02:53:33.889ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
28482024-11-07T02:53:33.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60340
28492024-11-07T02:53:33.962ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e6dcf98-e56c-4c04-9515-6f635bc8207c, kind: Service { id: 81e03cb2-6bdf-4324-a5c8-541c23e034b9 }, name: Name("external-dns-81e03cb2-6bdf-4324-a5c8-541c23e034b9"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b0270c81-c1ae-4f80-b64a-fc343b0f5d05, kind: Service { id: f2257614-9856-4344-bdd9-897edf2a5e03 }, name: Name("external-dns-f2257614-9856-4344-bdd9-897edf2a5e03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5babe071-e49d-4d68-8a86-a6faf41174c4, kind: Service { id: 585aaa98-c3b7-4a1f-979c-2088fe719dd8 }, name: Name("nexus-585aaa98-c3b7-4a1f-979c-2088fe719dd8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 121])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 639dd02e-77b1-44c5-bb10-e9604a99b455, kind: Service { id: 0d502811-de24-4e27-b92c-fccb5bf9f798 }, name: Name("nexus-0d502811-de24-4e27-b92c-fccb5bf9f798"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5ae62a3-3cee-4a00-a285-de4030662fb7, kind: Service { id: cfce6b5d-973c-4736-93fb-e3347600566b }, name: Name("nexus-cfce6b5d-973c-4736-93fb-e3347600566b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 227])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28502024-11-07T02:53:33.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28512024-11-07T02:53:33.963ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28522024-11-07T02:53:33.963ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28532024-11-07T02:53:33.963ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28542024-11-07T02:53:33.963ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28552024-11-07T02:53:33.963ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28562024-11-07T02:53:33.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 477 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60340 req_id = ec0fc4bd-32f7-4fee-9cb9-170dbc1648ff response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28572024-11-07T02:53:33.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130004 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48793 req_id = 46302753-acd5-479d-9415-1d89735f7c55 response_code = 204 uri = /switch-ports
28582024-11-07T02:53:33.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48793 req_id = 8bded02a-524f-4ce6-b890-d666c2a421de response_code = 200 uri = /network-bootstore-config
28592024-11-07T02:53:34.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 270426 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36790 req_id = 965e0b42-86b5-4d7a-bab5-22540420810e response_code = 200 uri = /inventory
28602024-11-07T02:53:39.352ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28612024-11-07T02:53:39.353ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28622024-11-07T02:53:39.356ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28632024-11-07T02:53:39.356ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28642024-11-07T02:53:39.853ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54117
28652024-11-07T02:53:39.853ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54117 req_id = 963e9d33-cf3b-4034-87a9-f240be740222 response_code = 200 uri = /baseboard
28662024-11-07T02:53:49.357ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28672024-11-07T02:53:49.357ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28682024-11-07T02:53:49.360ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28692024-11-07T02:53:49.361ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28702024-11-07T02:53:59.361ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28712024-11-07T02:53:59.361ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28722024-11-07T02:53:59.364ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28732024-11-07T02:53:59.365ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
28742024-11-07T02:54:02.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54117
28752024-11-07T02:54:02.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54117 req_id = 4025b9f4-504b-40b2-8782-edaafc73f9af response_code = 200 uri = /vpc-routes
28762024-11-07T02:54:02.260ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
28772024-11-07T02:54:02.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54117 req_id = 4e01f65c-3864-480d-8ca9-ef2075ddc514 response_code = 204 uri = /eip-gateways
28782024-11-07T02:54:02.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54117 req_id = bb32bd02-b21d-493d-83dd-701a2d722b97 response_code = 204 uri = /vpc-routes
28792024-11-07T02:54:02.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37778
28802024-11-07T02:54:02.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37778 req_id = 1dbe4cf3-8d9d-4a3c-b65a-460be645451e response_code = 200 uri = /v2p
28812024-11-07T02:54:02.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59973
28822024-11-07T02:54:02.440ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
28832024-11-07T02:54:02.483ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
28842024-11-07T02:54:02.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102728 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59973 req_id = ce7bdbb6-aa63-4bcf-9c1e-161dccbee5c6 response_code = 204 uri = /switch-ports
28852024-11-07T02:54:02.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59973 req_id = 4e4a0528-507e-4164-9a62-fe3e44a1f4f9 response_code = 200 uri = /network-bootstore-config
28862024-11-07T02:54:03.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50482
28872024-11-07T02:54:03.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50482 req_id = 1118ba51-de84-4a1b-8d4b-50ffc91e7276 response_code = 200 uri = /v2p
28882024-11-07T02:54:03.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39758
28892024-11-07T02:54:03.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39758 req_id = 5d0d00f8-c3c9-4d87-9f41-f03f0817a292 response_code = 200 uri = /vpc-routes
28902024-11-07T02:54:03.329ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
28912024-11-07T02:54:03.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39758 req_id = 4937de87-c269-494c-b39a-a13d9f24a89f response_code = 204 uri = /eip-gateways
28922024-11-07T02:54:03.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 447 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39758 req_id = fe40d3c1-9d96-485f-abef-bdacdf20170d response_code = 204 uri = /vpc-routes
28932024-11-07T02:54:03.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48451
28942024-11-07T02:54:03.357ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
28952024-11-07T02:54:03.402ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
28962024-11-07T02:54:03.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104076 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48451 req_id = 1166e65c-011b-4dd8-b719-a6edaccb6bc3 response_code = 204 uri = /switch-ports
28972024-11-07T02:54:03.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36160
28982024-11-07T02:54:03.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49706
28992024-11-07T02:54:03.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49706 req_id = bd05d63c-8683-47a0-9a39-05a0b40a00d8 response_code = 200 uri = /v2p
29002024-11-07T02:54:03.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36160 req_id = 27eec3a3-e89e-4d9e-ae7d-8c7006892893 response_code = 200 uri = /vpc-routes
29012024-11-07T02:54:03.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48451 req_id = 1b85acbf-8249-4cd8-afaa-4a955175ecc2 response_code = 200 uri = /network-bootstore-config
29022024-11-07T02:54:03.476ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
29032024-11-07T02:54:03.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36160 req_id = c16b425b-ec6e-48e3-9851-cc95d11c2db7 response_code = 204 uri = /eip-gateways
29042024-11-07T02:54:03.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36160 req_id = 855cd29d-0593-4662-8b99-7f63336ac1af response_code = 204 uri = /vpc-routes
29052024-11-07T02:54:03.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50704
29062024-11-07T02:54:03.488ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
29072024-11-07T02:54:03.530ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
29082024-11-07T02:54:03.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101954 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50704 req_id = 36e96d89-79c8-4ee9-821e-a516720334cf response_code = 204 uri = /switch-ports
29092024-11-07T02:54:03.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50704 req_id = 3eba51d1-ca7d-4574-accd-fa7ae9a3608d response_code = 200 uri = /network-bootstore-config
29102024-11-07T02:54:09.366ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29112024-11-07T02:54:09.366ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29122024-11-07T02:54:09.370ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29132024-11-07T02:54:09.370ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29142024-11-07T02:54:09.887ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63771
29152024-11-07T02:54:09.887ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63771 req_id = 7a57ed9f-c658-41d6-bc36-a25aa04aeee0 response_code = 200 uri = /baseboard
29162024-11-07T02:54:19.368ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29172024-11-07T02:54:19.369ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29182024-11-07T02:54:19.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29192024-11-07T02:54:19.372ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29202024-11-07T02:54:29.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29212024-11-07T02:54:29.371ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29222024-11-07T02:54:29.374ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29232024-11-07T02:54:29.375ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29242024-11-07T02:54:32.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51030
29252024-11-07T02:54:32.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51030 req_id = 2932a4b3-0050-4547-97c3-f427b091a164 response_code = 200 uri = /vpc-routes
29262024-11-07T02:54:32.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58402
29272024-11-07T02:54:32.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58402 req_id = 832c7746-289e-46bd-bed0-db89a0037c2e response_code = 200 uri = /v2p
29282024-11-07T02:54:32.436ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
29292024-11-07T02:54:32.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51030 req_id = ab43632c-cb0f-4cb1-9161-836554444a85 response_code = 204 uri = /eip-gateways
29302024-11-07T02:54:32.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51030 req_id = 744ac397-c976-4e21-b72d-28fdf52a5b07 response_code = 204 uri = /vpc-routes
29312024-11-07T02:54:32.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55253
29322024-11-07T02:54:32.553ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
29332024-11-07T02:54:32.595ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
29342024-11-07T02:54:32.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101659 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55253 req_id = 0515fb72-e9ad-4f4f-9627-90d421abbea2 response_code = 204 uri = /switch-ports
29352024-11-07T02:54:32.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55253 req_id = 3264599c-1888-4e8c-a980-d6312ad9ada9 response_code = 200 uri = /network-bootstore-config
29362024-11-07T02:54:32.744ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
29372024-11-07T02:54:33.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37533
29382024-11-07T02:54:33.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37533 req_id = 7823549e-b021-4397-a5dd-cd6c108a192c response_code = 200 uri = /v2p
29392024-11-07T02:54:33.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55564
29402024-11-07T02:54:33.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55564 req_id = eddb2130-06f1-4e3d-a2df-0af99825392b response_code = 200 uri = /vpc-routes
29412024-11-07T02:54:33.469ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
29422024-11-07T02:54:33.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55564 req_id = 967662a4-dfd2-436c-8eb4-ae2ec815104f response_code = 204 uri = /eip-gateways
29432024-11-07T02:54:33.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55564 req_id = 8de69b6d-397c-46d9-875f-650bc8b8af73 response_code = 204 uri = /vpc-routes
29442024-11-07T02:54:33.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33589
29452024-11-07T02:54:33.479ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
29462024-11-07T02:54:33.520ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
29472024-11-07T02:54:33.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97972 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33589 req_id = 95da863f-2329-4b89-a582-9bae10e89ad5 response_code = 204 uri = /switch-ports
29482024-11-07T02:54:33.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41599
29492024-11-07T02:54:33.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41599 req_id = 9a827e34-dc2d-4f41-8b34-b8f8e9de829e response_code = 200 uri = /v2p
29502024-11-07T02:54:33.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33589 req_id = 41a923cd-7920-4ae7-a889-e6f203b60f13 response_code = 200 uri = /network-bootstore-config
29512024-11-07T02:54:33.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51927
29522024-11-07T02:54:33.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51927 req_id = ef213f85-d51c-4701-ad47-fab10393d3af response_code = 200 uri = /vpc-routes
29532024-11-07T02:54:33.595ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
29542024-11-07T02:54:33.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51927 req_id = 1ebbf8b7-b048-4a0f-b3bb-ec83d32ee6fd response_code = 204 uri = /eip-gateways
29552024-11-07T02:54:33.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51927 req_id = f4ef0769-3807-4ba7-af3a-b54c2635f36e response_code = 204 uri = /vpc-routes
29562024-11-07T02:54:33.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65314
29572024-11-07T02:54:33.669ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
29582024-11-07T02:54:33.712ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
29592024-11-07T02:54:33.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104010 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65314 req_id = 764699e9-ce7a-4b46-9100-63bfe74dba33 response_code = 204 uri = /switch-ports
29602024-11-07T02:54:33.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65314 req_id = 298ce2b1-80db-4cb4-8c11-1d2f907cf8ba response_code = 200 uri = /network-bootstore-config
29612024-11-07T02:54:39.376ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29622024-11-07T02:54:39.376ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29632024-11-07T02:54:39.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29642024-11-07T02:54:39.380ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29652024-11-07T02:54:39.921ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51563
29662024-11-07T02:54:39.922ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51563 req_id = e36d5f15-085e-4c34-9623-d166517a78be response_code = 200 uri = /baseboard
29672024-11-07T02:54:48.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64368
29682024-11-07T02:54:48.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64368 req_id = 456ffdee-65df-4403-95bf-82b6a5bc2fb6 response_code = 200 uri = /v2p
29692024-11-07T02:54:48.393ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(8967473) }
29702024-11-07T02:54:48.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64368 req_id = e37695c0-2625-4707-9269-96c4e63caa08 response_code = 204 uri = /v2p
29712024-11-07T02:54:48.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48363
29722024-11-07T02:54:48.569ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a70705af-e6af-4c5d-b636-1cb0a749882a, kind: Instance { id: 1dfe8cb9-c140-4969-8157-e8e10b5b60cf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8967473), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a70705af-e6af-4c5d-b636-1cb0a749882a, kind: Instance { id: 1dfe8cb9-c140-4969-8157-e8e10b5b60cf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8967473), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a70705af-e6af-4c5d-b636-1cb0a749882a, kind: Instance { id: 1dfe8cb9-c140-4969-8157-e8e10b5b60cf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8967473), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(8967473))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a70705af-e6af-4c5d-b636-1cb0a749882a, kind: Instance { id: 1dfe8cb9-c140-4969-8157-e8e10b5b60cf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8967473), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-eafa78d6655", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 3d958fd0-476a-40f2-baba-747e7d3222c3, read_only_parent: Some(Volume { block_size: 512, id: 1463b5d0-2d2f-4aa8-9850-5eb99fc246f0, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 08e34d4e-a01d-4734-b235-231d967e3b96, key: Some("sFVxy04FT3Tf0dkTNjszxvLsdILI33TYcSisMm370hU="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3d958fd0-476a-40f2-baba-747e7d3222c3, key: Some("Ye6FY2Dz4DkrV1dDSElqRdGdVV2PAOaOLZEn6l1x3zI="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::15]:19003", "[fd00:1122:3344:101::1a]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-eafa78d6655" }] }), cloud_init_bytes: Some(..) } instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf metadata = InstanceMetadata { silo_id: 06aa31ff-df5e-46b3-9582-a8d7f84879ec, project_id: 42aee5f2-b268-4db6-94fe-58c62c5f028d } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-07T02:54:48.568656142Z }
29732024-11-07T02:54:48.569ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf migration_id = None propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29742024-11-07T02:54:48.569ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf migration_id = None propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a70705af-e6af-4c5d-b636-1cb0a749882a, kind: Instance { id: 1dfe8cb9-c140-4969-8157-e8e10b5b60cf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8967473), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a70705af-e6af-4c5d-b636-1cb0a749882a, kind: Instance { id: 1dfe8cb9-c140-4969-8157-e8e10b5b60cf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8967473), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a70705af-e6af-4c5d-b636-1cb0a749882a, kind: Instance { id: 1dfe8cb9-c140-4969-8157-e8e10b5b60cf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8967473), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(8967473))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a70705af-e6af-4c5d-b636-1cb0a749882a, kind: Instance { id: 1dfe8cb9-c140-4969-8157-e8e10b5b60cf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8967473), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-eafa78d6655", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 3d958fd0-476a-40f2-baba-747e7d3222c3, read_only_parent: Some(Volume { block_size: 512, id: 1463b5d0-2d2f-4aa8-9850-5eb99fc246f0, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 08e34d4e-a01d-4734-b235-231d967e3b96, key: Some("sFVxy04FT3Tf0dkTNjszxvLsdILI33TYcSisMm370hU="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3d958fd0-476a-40f2-baba-747e7d3222c3, key: Some("Ye6FY2Dz4DkrV1dDSElqRdGdVV2PAOaOLZEn6l1x3zI="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::15]:19003", "[fd00:1122:3344:101::1a]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-eafa78d6655" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-07T02:54:48.568656142Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29752024-11-07T02:54:48.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 941 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48363 req_id = 6da75cdd-b6c1-4a24-a4fc-487eb7cb1cf7 response_code = 200 uri = /vmms/c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29762024-11-07T02:54:48.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55276
29772024-11-07T02:54:48.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55276 req_id = dab19724-3c70-420f-8726-807f6ac27784 response_code = 200 uri = /vmms/c3959b79-99b1-4c65-bdb1-4e4e66b98e7e/state
29782024-11-07T02:54:48.647ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 8967473 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29792024-11-07T02:54:48.647ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
29802024-11-07T02:54:48.688ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e file = illumos-utils/src/zone.rs:325 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29812024-11-07T02:54:48.713ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e file = illumos-utils/src/zone.rs:363 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29822024-11-07T02:54:48.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34530
29832024-11-07T02:54:48.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34530 req_id = fce663c3-77d5-48a8-be75-0af0239e037e response_code = 200 uri = /vpc-routes
29842024-11-07T02:54:48.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {a70705af-e6af-4c5d-b636-1cb0a749882a: {10.151.1.175: {8ce1d7c3-c678-40da-8f59-3a1ab5a3df18}, 10.151.1.176: {8ce1d7c3-c678-40da-8f59-3a1ab5a3df18}}} }
29852024-11-07T02:54:49.379ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29862024-11-07T02:54:49.380ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29872024-11-07T02:54:49.382ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29882024-11-07T02:54:49.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
29892024-11-07T02:54:49.839ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29902024-11-07T02:54:49.840ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e zone file = illumos-utils/src/running_zone.rs:488 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e zone = oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29912024-11-07T02:54:50.031ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e") failed: Property not found. retry in 36.646058ms file = illumos-utils/src/svc.rs:36 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e zone = oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29922024-11-07T02:54:50.076ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e") failed: Property not found. retry in 67.301734ms file = illumos-utils/src/svc.rs:36 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e zone = oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29932024-11-07T02:54:50.177ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e") failed: Property not found. retry in 123.862374ms file = illumos-utils/src/svc.rs:36 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e zone = oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29942024-11-07T02:54:50.319ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e") failed: Property not found. retry in 314.464119ms file = illumos-utils/src/svc.rs:36 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e zone = oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29952024-11-07T02:54:50.651ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e") failed: Property not found. retry in 558.361791ms file = illumos-utils/src/svc.rs:36 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e zone = oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29962024-11-07T02:54:51.223ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e") failed: Property not found. retry in 1.411454512s file = illumos-utils/src/svc.rs:36 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e zone = oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29972024-11-07T02:54:52.646ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e") failed: Property not found. retry in 1.288210383s file = illumos-utils/src/svc.rs:36 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e zone = oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29982024-11-07T02:54:53.948ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e") failed: Property not found. retry in 703.950041ms file = illumos-utils/src/svc.rs:36 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e zone = oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
29992024-11-07T02:54:54.663ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e") failed: Property not found. retry in 974.406974ms file = illumos-utils/src/svc.rs:36 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e zone = oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30002024-11-07T02:54:55.665ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e file = sled-agent/src/instance.rs:1787 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30012024-11-07T02:54:55.673ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30022024-11-07T02:54:55.709ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30032024-11-07T02:54:55.847ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30042024-11-07T02:54:55.848ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30052024-11-07T02:54:55.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7076302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34530 req_id = a3ec996f-4689-44d5-a4fa-f0723afa4dcc response_code = 204 uri = /eip-gateways
30062024-11-07T02:54:55.852ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-07T02:54:55.852757622Z } file = sled-agent/src/instance.rs:780 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30072024-11-07T02:54:55.852ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-07T02:54:55.852757622Z } propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30082024-11-07T02:54:55.852ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-07T02:54:55.852757622Z }, migration_in: None, migration_out: None }
30092024-11-07T02:54:55.876ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-07T02:54:55.876266133Z } file = sled-agent/src/instance.rs:780 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30102024-11-07T02:54:55.876ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-07T02:54:55.876266133Z } propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30112024-11-07T02:54:55.876ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-07T02:54:55.876266133Z }, migration_in: None, migration_out: None }
30122024-11-07T02:54:55.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34530 req_id = ab6334e9-c653-4814-a769-d50ea4f6867a response_code = 204 uri = /vpc-routes
30132024-11-07T02:54:59.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30142024-11-07T02:54:59.383ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30152024-11-07T02:54:59.386ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30162024-11-07T02:54:59.387ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30172024-11-07T02:55:02.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43065
30182024-11-07T02:55:02.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43065 req_id = 326ee1f2-d95a-43ae-86a3-515738c90ca5 response_code = 200 uri = /v2p
30192024-11-07T02:55:02.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57375
30202024-11-07T02:55:02.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57375 req_id = c6cb4526-2653-4256-ab7d-7e585d130da6 response_code = 200 uri = /vmms/c3959b79-99b1-4c65-bdb1-4e4e66b98e7e/state
30212024-11-07T02:55:02.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49386
30222024-11-07T02:55:02.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49386 req_id = 09c9c66d-3a9c-4622-8cc0-0e007462b5ad response_code = 200 uri = /vpc-routes
30232024-11-07T02:55:02.284ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {a70705af-e6af-4c5d-b636-1cb0a749882a: {10.151.1.175: {8ce1d7c3-c678-40da-8f59-3a1ab5a3df18}, 10.151.1.176: {8ce1d7c3-c678-40da-8f59-3a1ab5a3df18}}} }
30242024-11-07T02:55:02.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49386 req_id = ca841b7d-4676-4f0a-b236-a1988086ce61 response_code = 204 uri = /eip-gateways
30252024-11-07T02:55:02.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49386 req_id = 9bc1f6cc-6962-4233-af16-2df9daf5646c response_code = 204 uri = /vpc-routes
30262024-11-07T02:55:02.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43512
30272024-11-07T02:55:02.414ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
30282024-11-07T02:55:02.458ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
30292024-11-07T02:55:02.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102742 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43512 req_id = 184a3dc4-d834-4f86-959a-049bd01577d0 response_code = 204 uri = /switch-ports
30302024-11-07T02:55:02.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43512 req_id = 2dbbb4a8-86b9-48c3-99c8-d923eb5d8f28 response_code = 200 uri = /network-bootstore-config
30312024-11-07T02:55:03.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36863
30322024-11-07T02:55:03.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36863 req_id = fe05cc71-f7e6-4824-9ecb-f4ecfdbe0469 response_code = 200 uri = /vmms/c3959b79-99b1-4c65-bdb1-4e4e66b98e7e/state
30332024-11-07T02:55:03.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40029
30342024-11-07T02:55:03.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40029 req_id = 6b4db39d-5cf9-4251-ac9a-99f541e01d58 response_code = 200 uri = /vpc-routes
30352024-11-07T02:55:03.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62608
30362024-11-07T02:55:03.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62608 req_id = 96663e21-045a-4ff9-aa55-b2cb94a38957 response_code = 200 uri = /vmms/c3959b79-99b1-4c65-bdb1-4e4e66b98e7e/state
30372024-11-07T02:55:03.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {a70705af-e6af-4c5d-b636-1cb0a749882a: {10.151.1.175: {8ce1d7c3-c678-40da-8f59-3a1ab5a3df18}, 10.151.1.176: {8ce1d7c3-c678-40da-8f59-3a1ab5a3df18}}} }
30382024-11-07T02:55:03.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40029 req_id = 6065c60b-6fc0-4f89-9995-e129fd2de8bc response_code = 204 uri = /eip-gateways
30392024-11-07T02:55:03.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39887
30402024-11-07T02:55:03.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39887 req_id = 239da831-b5aa-4c23-b1ee-6fdc65e78ac0 response_code = 200 uri = /vpc-routes
30412024-11-07T02:55:03.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40029 req_id = 2627d42e-412c-4c49-9d21-f016aecd443f response_code = 204 uri = /vpc-routes
30422024-11-07T02:55:03.373ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {a70705af-e6af-4c5d-b636-1cb0a749882a: {10.151.1.176: {8ce1d7c3-c678-40da-8f59-3a1ab5a3df18}, 10.151.1.175: {8ce1d7c3-c678-40da-8f59-3a1ab5a3df18}}} }
30432024-11-07T02:55:03.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39887 req_id = ca3edd3f-5f51-4119-a540-c726a6d25c00 response_code = 204 uri = /eip-gateways
30442024-11-07T02:55:03.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39887 req_id = 418ea5c6-09c3-498a-8263-28bd7b768564 response_code = 204 uri = /vpc-routes
30452024-11-07T02:55:03.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63300
30462024-11-07T02:55:03.409ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
30472024-11-07T02:55:03.453ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
30482024-11-07T02:55:03.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105321 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63300 req_id = 6ff1fc73-63d1-4060-80e1-0cc5b8897fca response_code = 204 uri = /switch-ports
30492024-11-07T02:55:03.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37487
30502024-11-07T02:55:03.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34557
30512024-11-07T02:55:03.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37112
30522024-11-07T02:55:03.515ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
30532024-11-07T02:55:03.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 860 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34557 req_id = 0264caee-f5de-4b73-89f8-afa87921e005 response_code = 200 uri = /v2p
30542024-11-07T02:55:03.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4730 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37487 req_id = e725a1a7-93fd-4463-af26-e2c2b829bb70 response_code = 200 uri = /v2p
30552024-11-07T02:55:03.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4758 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63300 req_id = f6ff65d2-7356-4fb9-b217-0065bcb7a2cf response_code = 200 uri = /network-bootstore-config
30562024-11-07T02:55:03.553ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
30572024-11-07T02:55:03.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100771 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37112 req_id = 9d895042-49a3-4c0f-ad28-f6d4fdb6cb9e response_code = 204 uri = /switch-ports
30582024-11-07T02:55:03.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37112 req_id = 322debcf-a564-42b8-8bf3-282d05212c87 response_code = 200 uri = /network-bootstore-config
30592024-11-07T02:55:06.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40186
30602024-11-07T02:55:06.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 576 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40186 req_id = 4f44b660-899f-48dd-9774-f6dd226a8d0b response_code = 200 uri = /vmms/c3959b79-99b1-4c65-bdb1-4e4e66b98e7e/state
30612024-11-07T02:55:06.166ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-07T02:55:06.166003780Z } file = sled-agent/src/instance.rs:780 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30622024-11-07T02:55:06.166ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-07T02:55:06.166003780Z } propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30632024-11-07T02:55:06.166ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-07T02:55:06.166003780Z }, migration_in: None, migration_out: None }
30642024-11-07T02:55:06.180ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-07T02:55:06.180386990Z } file = sled-agent/src/instance.rs:780 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30652024-11-07T02:55:06.180ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-07T02:55:06.180386990Z } propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30662024-11-07T02:55:06.180ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30672024-11-07T02:55:06.180ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
30682024-11-07T02:55:06.180ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 17806565859682331791 n_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30692024-11-07T02:55:06.180ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
30702024-11-07T02:55:06.180ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 13957634909079826003 n_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30712024-11-07T02:55:06.180ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/2d322320-6b0c-4ce3-949b-64e290d203c6/debug/bundle/zone", "/pool/int/f9d1c415-0734-4c1d-bad4-f5afd5058370/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/54f9243c-18e6-42c9-935c-0dc4151c5bea/crypt/debug", "/pool/ext/1e683710-2494-4ab1-a637-7b528e143c16/crypt/debug", "/pool/ext/e6e52c0a-a969-4298-91e8-02888028eb67/crypt/debug", "/pool/ext/9ad521f2-498d-459f-9590-bf571f0f7fe6/crypt/debug", "/pool/ext/7779de2f-377d-433e-9f3f-656a23324b51/crypt/debug", "/pool/ext/dddcfc0e-109d-4074-b924-e7a90aa78ab4/crypt/debug", "/pool/ext/93fe9b26-7c2f-4e28-82f2-0a5320409e66/crypt/debug", "/pool/ext/01d7d0b3-ada7-4e85-a6b4-686ef3c7940e/crypt/debug", "/pool/ext/655eee30-398b-4d0f-848d-1f66d242e6b9/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30722024-11-07T02:55:06.850ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e", bundle_id: 630764c9-bc4f-4744-8320-974fcd45c29a }, time_created: 2024-11-07T02:55:06.181497379Z, version: 0, cause: TerminatedInstance }
30732024-11-07T02:55:06.850ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_c3959b79-99b1-4c65-bdb1-4e4e66b98e7e file = sled-agent/src/instance.rs:1032 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30742024-11-07T02:55:08.574ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30752024-11-07T02:55:08.591ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(8967473), kind: System }
30762024-11-07T02:55:08.591ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(8967473), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30772024-11-07T02:55:08.592ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-07T02:55:08.592126535Z }, migration_in: None, migration_out: None }
30782024-11-07T02:55:08.618ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-07T02:55:08.592126535Z }, migration_in: None, migration_out: None }
30792024-11-07T02:55:08.622ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 1dfe8cb9-c140-4969-8157-e8e10b5b60cf propolis_id = c3959b79-99b1-4c65-bdb1-4e4e66b98e7e
30802024-11-07T02:55:09.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44761
30812024-11-07T02:55:09.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44761 req_id = 7eefe0ce-c4a4-49e3-a2fc-71044b249c9d response_code = 200 uri = /vpc-routes
30822024-11-07T02:55:09.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
30832024-11-07T02:55:09.078ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30842024-11-07T02:55:09.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44761 req_id = c7390707-ace8-4eae-9c17-21fdb1fe9961 response_code = 204 uri = /eip-gateways
30852024-11-07T02:55:09.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34394
30862024-11-07T02:55:09.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34394 req_id = 5c58002d-d84f-4413-ac2a-01efd6269e82 response_code = 200 uri = /v2p
30872024-11-07T02:55:09.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44761 req_id = a56d4c5d-e195-42fa-96da-7c81ad6692f1 response_code = 204 uri = /vpc-routes
30882024-11-07T02:55:09.388ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30892024-11-07T02:55:09.389ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30902024-11-07T02:55:09.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30912024-11-07T02:55:09.393ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9
30922024-11-07T02:55:09.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64793
30932024-11-07T02:55:09.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64793 req_id = 0e696c49-bb58-48fa-bec2-7b1aecb2b4c9 response_code = 200 uri = /v2p
30942024-11-07T02:55:09.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41395
30952024-11-07T02:55:09.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41395 req_id = 85dae75b-8fcb-4587-a862-a70f8d85bb8a response_code = 200 uri = /vpc-routes
30962024-11-07T02:55:09.763ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
30972024-11-07T02:55:09.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41395 req_id = 3a513166-a2e5-4d0b-b4ca-94bf802ea881 response_code = 204 uri = /eip-gateways
30982024-11-07T02:55:09.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41395 req_id = ca1d4787-a00a-4d08-bc94-0b42ffd19015 response_code = 204 uri = /vpc-routes
30992024-11-07T02:55:09.958ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56402
31002024-11-07T02:55:09.959ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56402 req_id = b57ff890-85d0-4de1-a0ac-565095ba7f4f response_code = 200 uri = /baseboard
31012024-11-07T02:55:10.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61645
31022024-11-07T02:55:10.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61645 req_id = 654d790f-8d28-4f8b-900f-42ab932df2ca response_code = 200 uri = /vpc-routes
31032024-11-07T02:55:10.302ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = ed4702f9-ad41-4221-9a83-4f7d256be0d9 values = ExternalIpGatewayMap { mappings: {} }
31042024-11-07T02:55:10.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61645 req_id = 02552fec-cf7d-4b8b-a95d-a4e9c5fce554 response_code = 204 uri = /eip-gateways
31052024-11-07T02:55:10.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61645 req_id = 68b12d31-0e8f-4d66-a866-2d9f937475a9 response_code = 204 uri = /vpc-routes